Staff Machine Learning Engineer, Generative AI
OktaOkta is a
Toronto, Canada$168,000 - $231,000 CADLead
Data & AI
About the role
TL;DR
Architect and deploy production-ready Generative AI systems at scale.
- •Okta is seeking a Staff Machine Learning Engineer to shape and accelerate its Generative AI strategy.
- •This role involves architecting and deploying production-ready AI/ML systems at scale, from LLM-powered features to reusable components.
- •Key Responsibilities Architect, design, and deploy robust Machine Learning & GenAI systems with scalable LLMOps pipelines.
- •Lead initiatives to tune, optimize, and deploy agentic applications in production.
- •Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.
- •Develop and iterate on structured prompting, context retrieval, and RAG workflows.
- •Build and refine automated evaluation pipelines to measure model quality and safety.
- •Requirements 7+ years of software development experience, with strong Python expertise.
- •Hands-on experience with applied machine learning, model training, and fine-tuning.
- •Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic).
- •Deep understanding of retrieval-augmented generation (RAG) and knowledge-base workflows.
- •Hands-on experience with AI agent frameworks like LiteLLM, LangGraph, LangChain, or LlamaIndex.
Required skills
PythonLLMsOpenAI APIAnthropic APILangChainFastAPIPyTorchTensorFlowAirflow
Nice-to-have skills
GoTypeScript
Domain expertise
developer-toolsaiproductivity
Benefits & perks
Equity, Bonus, Health insurance, Dental insurance, Vision insurance, RRSP with a match, Healthcare spending, Telemedicine, Paid leave, PTO, Parental leave
Tech stack
PythonGoTypeScriptOpenAI APIAnthropic APILangChainFastAPIPyTorchTensorFlowAirflow
