P
Principal ML System Engineer
PointClickCareEHR for company
MississaugaLead
Dragoneer Investment Group
Hellman & Friedman
JMI Equity
Data & AI
About the role
TL;DR
Builds infrastructure connecting AI systems with products for seamless AI insights delivery.
- •The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows.
- •Key Responsibilities Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- •Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
- •Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- •Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
- •Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.
- •Requirements Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
- •Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, NLPFlow).
- •Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
Required skills
KubernetesLLMsPython
Nice-to-have skills
LangChainCI/CD
Domain expertise
ai
Tech stack
KubernetesDockerPythonJavaScriptBashOpenAI APILangChainLLMsCI/CDGit
