About the role
TL;DR
Build and operate backend systems for AI features, focusing on inference and orchestration.
- •As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product.
- •Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.
- •Key Responsibilities Build and operate backend systems that serve AI-powered features in production.
- •Design inference pipelines, orchestration layers, and service boundaries around models.
- •Own production concerns: monitoring, logging, alerting, and incident response.
- •Optimize latency and throughput across inference, caching, batching, and streaming.
- •Requirements Strong backend engineering fundamentals in production environments.
- •Experience running high-throughput, low-latency services.
- •Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
- •Comfortable debugging distributed systems under load.
- •Bias toward shipping and learning from production behavior.
Required skills
PythonNode.jsKubernetesDockerSQLOpenAI APIAnthropic APIPyTorch
Domain expertise
ai
Tech stack
PythonNode.jsPyTorchOpenAI APIAnthropic APISQLKubernetesDocker