Member of Technical Staff, Performance and Scale
InferactAI Inference company
SingaporeS$200,000 - S$400,000 annuallyLead
Andreessen Horowitz
Lightspeed Venture Partners
Sequoia Capital
Altimeter Capital
Redpoint Ventures
ZhenFund
Software Engineering
About the role
TL;DR
Build distributed systems for global-scale AI inference.
- •We're looking for an infrastructure engineer to build the distributed systems that power inference at global scale.
- •Key Responsibilities Design and implement the foundational layers that enable vLLM to serve models across thousands of accelerators with minimal latency and maximum reliability.
- •Absorb the complexity of deploying a frontier model at scale into the infrastructure you're building.
- •Requirements Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- •Strong systems programming skills in Rust, Go, or C++.
- •Experience designing and building high-performance distributed systems at scale.
- •Understanding of network protocols and high-performance I/O.
- •Ability to debug complex distributed systems issues.
Required skills
RustGoC++
Domain expertise
ai
Benefits & perks
equity, health insurance, visa sponsorship
Tech stack
RustGoC++