Member of Technical Staff, Agentic Environments
CohereLarge Language company
RemoteLead
Radical Ventures
NVIDIA
Salesforce Ventures
Index Ventures
Inovia Capital
Oracle
Data & AI
About the role
TL;DR
Design and build scalable AI systems for production environments.
- •Cohere is seeking a senior engineer to push the boundaries of AI systems in production environments.
- •This hands-on role bridges research concepts with real-world implementations, focusing on building scalable, production-ready solutions.
- •Key Responsibilities Design and write high-performing, scalable software for training models.
- •Develop new tools to accelerate research and LLM training.
- •Coordinate with infrastructure, efficiency, serving, and scientific teams.
- •Research, implement, and experiment with ideas on cluster and data infrastructure.
- •Requirements Extremely strong software engineering skills.
- •Proficiency in Python and ML frameworks like JAX, PyTorch, or XLA/MLIR.
- •Experience with large-scale distributed training strategies and infrastructures (Kubernetes, Ray).
- •Experience in ML and LLM academic research.
Required skills
PythonJAXPyTorchKubernetesLLMsNLPGitLinux
Domain expertise
aideeptech
Benefits & perks
Weekly lunch stipend, Full health and dental benefits, Mental health budget, RRSP matching, 401K, Pension Scheme, 100% Parental Leave top-up, Annual enrichment benefits (Arts & culture, fitness/wellness, quality time, workspace improvement), Education & learning stipend, 6 weeks of paid vacation, Budget for traveling to other offices, Annual company offsite, Co-working benefit, $500 home office stipend
Tech stack
PythonJAXPyTorchKubernetesGitLinux