Senior Product Manager, Inference Platform
RobloxUser-Generated Content company
San Mateo, United States$280,540 - $330,950 USDSenior
Altimeter Capital
Dragoneer Investment Group
Andreessen Horowitz
Tencent
First Round Capital
Warner Music Group
ProductNew
About the role
TL;DR
Lead the Inference Platform, Roblox's AI inference orchestration system.
- •Inference Platform is Roblox's multi-tier orchestration system for microservices, powering AI Inference across Roblox.
- •Through a simple developer API, we deliver a "deploy and forget" runtime, hiding the complexity of scheduling, scaling, and reliably running services across our on-prem and multi-cloud footprint at global scale.
- •Key Responsibilities Own Inference Platform end-to-end, setting the multi-year vision for how Roblox engineers deploy, run, and scale AI and other services.
- •Build the platform that brings frontier models and next-gen AI workloads to life.
- •Define how Roblox prioritizes, isolates, and preempts workloads across shared fleet.
- •Deliver integrated tooling (CI/CD, telemetry, profiling, tracing) and manage robust SLOs.
- •Advance Multi-Cloud Bursting from reactive to proactive with AI-powered prediction.
- •Requirements 7+ years of product management experience building resource orchestration, workload management platforms or large-scale distributed systems.
- •Track record of building developer-facing platforms that engineers genuinely love to use.
- •Experience building and operating Kubernetes and enterprise-grade service mesh at scale.
- •Familiarity with GPU/accelerator architecture and scheduling challenges.
- •Background in AI model development, training, inference.
Required skills
Product ManagementKubernetesMicroservicesLLMsProduct StrategyRoadmappingFeature PrioritizationAgileScrumPRDsOKRsProgram ManagementProject Management
Nice-to-have skills
AWSGoogle CloudAzureTensorFlowPyTorchscikit-learnOpenAI APIAnthropic APIGemini APILangChain
Domain expertise
developer-toolsai
Tech stack
PythonJavaScriptKubernetesAWSGoogle CloudAzureDockerCI/CDMicroservicesLLMsTensorFlowPyTorchscikit-learnOpenAI APIAnthropic APIGemini APILangChainHugging FaceComputer VisionNLPMLflowKubeflowSageMakerVertex AIONNXJAXGitLinuxJiraConfluence