Senior Software Engineer, Inference

Build and maintain critical distributed systems for serving AI models to millions of users.

• •Anthropic's mission is to create reliable, interpretable, and steerable AI systems.
• •The Inference team builds and maintains critical systems serving Claude to millions of users worldwide, handling the entire stack from request routing to fleet orchestration across diverse AI accelerators.
• •Key Responsibilities Design, build, and maintain distributed systems serving Claude to millions of users.
• •Develop resilient, flexible systems that adapt in real time.
• •Build and operate production-grade deployment pipelines for releasing new models.
• •Integrate new AI accelerator platforms and support inference for new model architectures.
• •Requirements Proficiency in Python or Rust.
• •Experience building and operating distributed systems in production.
• •Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure).
• •Desire to learn more about machine learning systems and infrastructure.