Member of Technical Staff, Cloud Orchestration
InferactAI Inference company
SingaporeS$200,000 - S$400,000 annuallyLead
Andreessen Horowitz
Lightspeed Venture Partners
Sequoia Capital
Altimeter Capital
Redpoint Ventures
ZhenFund
Software Engineering
About the role
TL;DR
Design and implement systems for reliable vLLM cloud orchestration.
- •We're looking for a cloud orchestration engineer to build the operational backbone for vLLM.
- •You'll design systems for cluster management, deployment automation, and production monitoring.
- •Key Responsibilities Design systems for cluster management, deployment automation, and production monitoring.
- •Ensure vLLM deployments are observable, debuggable, and recoverable.
- •Manage GPU clusters and debug hardware issues.
- •Requirements Bachelor's degree in computer science, engineering, or similar.
- •Strong experience with Kubernetes and container orchestration at scale.
- •Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Required skills
KubernetesPythonRustGoTerraformHelmAWSGoogle CloudAzure
Domain expertise
ai
Benefits & perks
equity, medical, dental, vision coverage
Tech stack
KubernetesPythonRustGoTerraformHelmAWSGoogle CloudAzure