Software Engineer, Platform
OpenRouterLLM API company
RemoteSenior
Andreessen Horowitz
Menlo Ventures
Sequoia Capital
Figma
Fred Ehrsam
Software Engineering
About the role
TL;DR
Own and scale systems for routing and serving LLM requests.
- •OpenRouter is seeking a Software Engineer for its Platform team to own and scale the systems that route and serve millions of LLM requests daily.
- •The business is experiencing rapid growth, requiring a platform that can keep pace.
- •Key Responsibilities Own and evolve edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel.
- •Scale and operate the data layer including Spanner, ClickHouse, and Postgres.
- •Optimize performance for serving LLM inference as traffic grows.
- •Partner with leadership on capacity, reliability, and cost across the routing layer.
- •Set the playbook for infrastructure and operations, including tooling and observability.
- •Requirements 5+ years building and operating production infrastructure where uptime, latency, and cost are critical.
- •Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms.
- •Deep expertise in operating large-scale databases (e.g., Postgres, Spanner).
- •Proficiency across the full stack, particularly with TypeScript.
- •High agency and a bias toward action.
Required skills
Google CloudPostgreSQLTypeScriptAWSAzureCI/CDKubernetesDocker
Nice-to-have skills
TerraformCloudFormationPulumiEC2S3RDSECSEKSGKECloud Run
Tech stack
Google CloudPostgreSQLTypeScript