Member of Technical Staff, CI/CD Infrastructure
InferactAI Inference company
San Francisco, United States$200K - $400KLead
Andreessen Horowitz
Lightspeed Venture Partners
Sequoia Capital
Altimeter Capital
Redpoint Ventures
ZhenFund
Software Engineering
About the role
TL;DR
Advance CI system to scale with vLLM's momentum.
- •Advance the CI system to scale with vLLM's momentum and unlock faster development for everyone.
- •Key Responsibilities Maintain and scale the compute infrastructure for CI, release, performance benchmark, accuracy evaluation.
- •Reduce CI time-to-signal from hours to minutes.
- •Ensure every corner of vLLM code base is well-tested.
- •Keep vLLM releases rock-solid.
- •Build out tooling for vLLM contributors.
- •Requirements Strong experience with Docker, Kubernetes, and containerized build or test environments.
- •Built CI/CD pipelines from scratch using GitHub Actions, Buildkite, or similar systems.
- •Familiar with CI design patterns and CI techniques.
- •Fluent in Python, Bash, Go, or similar for automation and tooling.
- •Solid fundamentals of Linux, security, networking, storage, package management.
Required skills
DockerKubernetesCI/CDGitHub ActionsPythonBashLinux
Domain expertise
ai
Benefits & perks
equity, health insurance, 401(k) company match
Tech stack
DockerKubernetesCI/CDGitHub ActionsPythonBashLinux