Backend Engineer - API

Build and maintain the xAI API for high-throughput inference.

• •As a Backend Engineer, you will build the xAI API that serves our models to developers worldwide.
• •You will own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability.
• •Key Responsibilities Build the xAI API that serves our models to developers worldwide Own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability Develop model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling Requirements Expert knowledge of either Rust or C++ Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems Knowledge of service observability and reliability best practices Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB