Software Engineer, AI Infra
PikaGenerative AI company
Palo Alto, United StatesLead
Lightspeed Venture Partners
Spark Capital
Greycroft
SV Angel
Homebrew
Conviction
Data & AI
About the role
TL;DR
Lead the design and implementation of GPU infrastructure, AI model serving APIs, and general AI infrastructure execution.
- •We are looking for a Staff/Lead Software Engineer, AI Infrastructure, to build and scale the core infrastructure that powers Pika’s AI capabilities.
- •Key Responsibilities Design, develop, and maintain scalable GPU infrastructure for training and serving state-of-the-art AI models Architect and optimize high-throughput, low-latency APIs for AI model serving and inference Lead the orchestration, scheduling, and efficient utilization of heterogeneous GPU resources across clusters Build and support robust systems for model deployment, monitoring, scaling, and reliability in production environments Collaborate with ML, backend, and platform engineering teams to deliver seamless AI-powered product features Drive technical direction, code reviews, and mentorship across the AI Infrastructure team Requirements Strong experience (5+ years) as a software engineer working on systems infrastructure, including hands-on work with ML serving and GPU orchestration Deep knowledge of distributed systems, Kubernetes (or similar orchestration frameworks), and cloud-native infrastructure (AWS/GCP/Azure) Proven expertise in building and optimizing APIs for large-scale AI model serving (TensorFlow Serving, Triton, TorchServe, or similar) Familiarity with the challenges of high-throughput, scalable GPU fleet management, scheduling, and efficient model execution Proficiency in backend languages such as Python, Go, or C++, and experience optimizing for performance and reliability Ownership mentality and the drive to solve complex problems independently in ambiguous, high-growth environments Excellent communication, collaborative, and mentorship skills
Required skills
PythonKubernetesTensorFlowAWSGo
Nice-to-have skills
LLMs
Domain expertise
ai
Benefits & perks
Competitive salary in the AI industry, Equity in a rapidly growing team shaping the future of AI, Comprehensive health benefits, monthly stipends, and company retreats
Tech stack
PythonKubernetesTensorFlowAWSGo