Senior AI/ML Engineer
Flo Health · London, United Kingdom · A decade of building – and we’re still accelerating. Flo is the world’s #1 health & fitness app worldwide on a mission to build a better future for female health. Backed by a $200M investment led by General Atlantic, we became the first product of our kind to reach a $1B valuation in 2024 – and we’re not slowing down. With 7M paid subscribers and the highest-rated experience in the App Store’s health category, we’ve spent 10 years earning trust at scale. Now, we’re building the next generation of digital health – AI-powered, privacy-first, clinically backed – to help our users know their body better. We are looking for a Senior Software Engineer with deep expertise in AI/ML infrastructure to join our AI Platform team and help build the GenAI platform that powers every AI feature at Flo. You will bridge core infrastructure, data engineering, and LLM development to deliver production-grade medical safety judges, fine-tuning pipelines, evaluation frameworks, and real-time personalization. The team operates 60+ LLM-based evaluation judges, develops proprietary fine-tuned health models, and maintains active partnerships with Databricks, Google, OpenAI, Anthropic, and AWS. You will build and scale Judge-as-a-Service, prompt registries, calibration pipelines, and evaluation orchestration using MLflow 3.x. You will develop LoRA/SFT/preference optimization pipelines for health-domain models (Llama, Gemma, MedGemma) and manage model serving at scale on Databricks. You will build synthetic Q&A generation, golden test sets, reward function engineering, and Delta table schemas in Unity Catalog for reliable, reproducible evaluation data. You will maintain Terraform-managed AWS infrastructure (EKS, S3, IAM), Databricks AI Gateway, and CI/CD pipelines (GitHub Actions) with evaluation gates and progressive rollout. You will collaborate with Product, Security, Analytics, and Medical teams, develop internal SDKs and APIs consumed by 5+ teams, and engage directly with technology partners on pre-release capabilities. Must have: 7+ years of software engineering, 4+ years focused on ML/AI platforms. Recent hands-on work with at least one of: fine-tuning, prompt engineering, LLM evaluation, or model serving. Strong Python across production services and data pipelines, data engineering fundamentals (Spark, Delta tables, Parquet). Experience with Databricks (MLflow, Unity Catalog, Model Serving), AWS (EKS/Kubernetes, IAM), Terraform, GitHub Actions. Comfort working across ML, data engineering, and infrastructure. Nice to have: LLM evaluation frameworks (judges, graders, calibration methodology) or fine-tuning techniques (LoRA, RLHF/DPO, model distillation). ML data engineering: synthetic data generation, evaluation dataset design, annotation pipelines. Healthcare, regulated industry, or safety-critical AI systems experience. Prompt optimization frameworks (DSPy or similar), feature stores (Tecton). · Senior
Data & AI