Machine Learning Infrastructure Tech Lead
ReductoAI Document company
San Francisco, United StatesLead
Andreessen Horowitz
Benchmark
First Round Capital
BoxGroup
Y Combinator
Data & AI
About the role
TL;DR
Lead ML infrastructure development, optimizing training and inference systems.
- •Reducto is seeking a Machine Learning Infrastructure Tech Lead to own the systems that enable high-performance model training and inference.
- •This is a hands-on role focused on building, debugging, and optimizing infrastructure, with 20% dedicated to technical direction and roadmap planning.
- •Key Responsibilities Own the technical direction and roadmap for Reducto's ML infrastructure.
- •Build and maintain the training and inference stack, balancing experimentation with production serving.
- •Optimize model serving at every layer, including kernels, runtimes, batching, scheduling, and distributed inference.
- •Design systems for reliable multi-node, multi-GPU training and inference.
- •Improve GPU utilization, latency, throughput, reliability, observability, and cost efficiency.
- •Requirements 5+ years of experience building production infrastructure, including significant ML systems experience.
- •Experience leading complex technical projects from ambiguity to production.
- •Strong Python and systems-engineering skills.
- •Understanding of modern GPU training or inference workload performance characteristics.
- •Comfort with Kubernetes and distributed training or serving frameworks.
Required skills
PythonKubernetesBashMLflowKubeflowSageMakerVertex AITensorFlowPyTorchscikit-learnLangChainHugging FaceLLMsCI/CD
Domain expertise
aideveloper-tools
Benefits & perks
Unlimited PTO, Daily Lunch, Commuter Reimbursement, Comprehensive Insurance, Health and Wellness Budget, Parental Leave
Tech stack
PythonKubernetesPyTorchBash
