Staff Product Manager, Inference
LiveKitReal-time Communication company
RemoteLead
Index Ventures
Salesforce Ventures
Altimeter Capital
Redpoint Ventures
Hanabi Capital
Product
About the role
TL;DR
Owns the LiveKit Inference roadmap, managing AI models for voice applications.
- •LiveKit is seeking a Staff Product Manager to own LiveKit Inference, a critical product providing developers managed access to leading voice AI models.
- •This role involves setting the vision and roadmap for the inference gateway, managing commercial relationships with model labs, and overseeing direct model hosting and optimization.
- •Key Responsibilities Own the LiveKit Inference roadmap, setting vision and sequencing product development with engineering.
- •Ship a model layer that becomes the default choice for developers, improving ease of use and performance over direct integrations.
- •Stay ahead of the rapidly evolving model landscape by deciding which models and providers to integrate.
- •Grow the value and capture for LiveKit by consolidating model spend and enhancing customer value.
- •Deeply understand customer usage patterns through data and direct engagement to shape product priorities.
- •Requirements 8+ years in product management, ideally with experience in developer-facing APIs, platforms, or AI/ML products.
- •Strong technical understanding of model serving, routing, latency, and quality tradeoffs.
- •Experience owning products where cost, performance, and provider tradeoffs are central.
- •Proven ability to influence cross-functional teams through clarity, trust, and good judgment.
- •Exceptional written and verbal communication skills, capable of engaging with both executives and technical leads.
Required skills
Product ManagementLLMsProduct StrategyGo-to-MarketFeature PrioritizationCustomer DiscoveryProduct AnalyticsCompetitive AnalysisPythonJavaScriptTypeScript
Nice-to-have skills
OpenAI APIAnthropic APIGemini APILangChainHugging FaceREST APIgRPCWebSockets
Domain expertise
developer-toolsai
Benefits & perks
equity, health insurance, dental insurance, vision insurance, flexible vacation policy
Tech stack
PythonJavaScriptTypeScriptGoOpenAI APIAnthropic APIGemini APILangChainHugging FaceLLMsREST APIgRPCWebSockets