Member of Technical Staff — Developer Technology
RadixArkAI Infrastructure company
Palo Alto, United States$200,000 - $400,000 USDLead
Accel
Spark Capital
NVentures
Salience Capital
A&E Investments
HOF Capital
Software Engineering
About the role
TL;DR
Optimize LLM inference and training for speed and cost on GPU hardware.
- •RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware.
- •Our systems sit at the center of how modern AI is served and trained: SGLang is a high-performance inference engine that serves trillions of tokens daily across leading AI companies and research labs, and Miles is our reinforcement-learning post-training framework for large-scale LLM and MoE models.
- •Your work directly advances our mission to democratize AI: every improvement you ship lowers the cost and raises the ceiling of what developers everywhere can build.
- •Key Responsibilities Profile and optimize GPU performance for real production workloads on current and next-generation hardware, root-causing bottlenecks from kernels to distributed multi-node systems.
- •Specialize in areas like inference performance, kernels and model/hardware enablement, speculative decoding, or training systems.
- •Partner directly with the ecosystem to turn ambiguous, high-stakes problems into concrete wins and clear technical guidance.
- •Enhance SGLang and Miles by feeding user-driven improvements back into our open-source systems and roadmap.
- •Requirements 4+ years of experience in GPU systems, LLM infrastructure, or performance engineering.
- •Strong profiling and debugging skills to root-cause performance and correctness issues.
- •Hands-on GPU programming experience in CUDA, ROCm, or Triton.
- •Strong programming skills in Python and C++ or CUDA.
- •Ability to make progress on ambiguous problems and ramp into unfamiliar systems quickly.
Required skills
PythonC++LLMsGitLinux
Nice-to-have skills
TensorFlowPyTorchKubernetesDockerAWSGoogle CloudAzure
Domain expertise
aideveloper-tools
Benefits & perks
equity
Tech stack
PythonC++AWSGoogle CloudAzureDockerKubernetesGit
