Senior/Staff ML Ops Engineer
FilevineLegal Case company
Prague, Czech RepublicLead
Insight Partners
Accel
Halo Fund
Meritech
Stepstone
Album Ventures
Data & AINew
About the role
TL;DR
Build and own systems for faster, safer, and more trustworthy AI capabilities at scale.
- •As a Senior MLOps Engineer at Filevine, you'll build and own the systems that make Filevine's AI capabilities faster to develop, safer to ship, and easier to trust, at scale.
- •Key Responsibilities Setup and maintain LLM observability frameworks/tools Ensure stability of LLM calls (rate limits, provisioned throughput, backups, …) Hosting finetuned/open weight machine learning models Platform tooling for enabling non-technical people (e.g.
- •PMs) to iterate on prompts Requirements 5+ years building and operating software systems end-to-end Hands-on experience with ML infrastructure: model serving, training pipelines, or LLM integrations in production Strong understanding of cloud infrastructure and distributed systems (primarily AWS) Familiarity with observability tooling and cost management for LLM workloads
Required skills
PythonAWSKubernetesTerraformLLMsMLflowSageMakerVertex AI
Nice-to-have skills
LangChainHugging FaceOpenAI APIAnthropic APIGemini API
Domain expertise
legaltechai
Tech stack
AWSPythonKubernetesTerraformLLMsOpenAI APILangChainHugging Face