Machine Learning Infra Engineer
ReductoAI Document company
San Francisco, United StatesMid
Andreessen Horowitz
Benchmark
First Round Capital
BoxGroup
Y Combinator
Data & AI
About the role
TL;DR
Build and maintain ML training and inference stack.
- •As an ML Infra Engineer, you'll build and maintain our training and inference stack, collaborating with ML and Platform teams to scale training and improve efficiency.
- •Key Responsibilities Build and maintain our training and inference stack.
- •Develop benchmarks to identify bottlenecks.
- •Explore and apply SOTA advances in training and inference.
- •Design systems for scaling model training across multi-node, multi-GPU environments.
- •Scale distributed training and inference workloads across large GPU clusters.
- •Requirements Hold yourself to a high bar for quality and precision.
- •Enjoy solving complex problems and building from first principles.
- •Have strong Python skills and a background in systems engineering.
- •Are comfortable with Kubernetes and distributed training frameworks.
- •Have 3+ years of experience.
Required skills
PythonKubernetes
Tech stack
PythonKubernetes