Member of Technical Staff, Infrastructure
The Token CompanyLLM Input company
San Francisco, United StatesLead
Y Combinator
Pioneer Fund
Wave Ventures
Software Engineering
About the role
TL;DR
Own and improve cloud systems for LLM input compression API.
- •The Token Company is a seed stage startup in San Francisco, CA, focused on compressing raw LLM inputs before they are passed to the expensive LLMs.
- •As a Member of Technical Staff on our infrastructure team, you'll own the cloud systems that serve our compression API end-to-end.
- •Key Responsibilities Build global low-latency, high-throughput GPU ML inference infra Manage deployment, scaling, reliability, and cost-efficiency Learn and improve new solutions and technologies Requirements Quick learner with a focus on moving fast Strong in cloud infrastructure, comfortable with AWS, Terraform, Docker, and CI/CD Experience owning an infra stack end-to-end
Required skills
AWSTerraformDockerCI/CD
Domain expertise
crypto
Benefits & perks
equity, housing, food, laundry, cleaning, visa sponsorship
Tech stack
AWSTerraformDockerCI/CD