Software Engineer, Platform & Inference
Chai DiscoveryAI Drug company
San FranciscoSenior
Oak HC/FT
General Catalyst
Thrive Capital
Menlo Ventures
OpenAI
Dimension
Software Engineering
About the role
TL;DR
Platform engineers make Chai's models fast, cheap, and reliable at scale.
- •Platform engineers make Chai's models fast, cheap, and reliable at scale, and enable the outer loop that accelerates research.
- •Key Responsibilities Own the serving stack that turns our frontier models into a product scientists depend on.
- •Contribute to the work that enables turning raw models into product-ready pipelines.
- •Work closely with researchers, product engineers, and the commercial team.
- •Requirements 4+ years building production systems, with real depth in performance, distributed systems, or ML serving.
- •Experience optimizing model inference: GPU utilization, batching, quantization, caching, or kernel-level work.
- •A platform mindset: you like building the tools and abstractions that make other engineers and researchers faster.
Required skills
PythonKubernetesCI/CDMicroservices
Domain expertise
healthcare
Tech stack
PythonKubernetesCI/CDMicroservices
