Lead, Product Safety & Wellbeing
Metaphore BiotechnologiesDrug Discovery company
Cambridge, United States$138,000 - $181,500Lead
Flagship Pioneering
ProductNew
About the role
TL;DR
Lead product safety and wellbeing by defining and improving safety systems and user experience.
- •We are looking for an experienced and creative leader to own and continually improve product performance.
- •This person will lead on how we define and measure safety, and partner across disciplines to strengthen our evaluations, safety systems, and user experience.
- •Key Responsibilities Serve as the subject matter expert on safety systems, owning the safety roadmap and continuously improving guardrails as the product evolves.
- •Develop a deep, data-driven understanding of product performance across safety risks.
- •Develop and evolve safety frameworks, benchmarks, evaluation methodologies, rubrics, quality standards, and meaningful safety metrics.
- •Lead human and automated evaluation programs, including annotation programs, annotator and AI judge training and calibration.
- •Partner with Engineering, ML, Product, and Data Science to improve risk detection, prompting strategies, response generation, routing and escalation logic.
- •Requirements Advanced training (PhD, PsyD, LCSW, or equivalent experience) in psychology, behavioral science, mental health, or a closely related field.
- •Deep expertise in psychological safety, crisis response, and risk assessment.
- •Experience developing evaluation frameworks or quality assurance processes.
- •Excellent communication, analytical, and problem-solving skills.
- •Ability to collaborate effectively with engineers, researchers, designers, and product managers.
Required skills
NLPLLMsOpenAI APIAnthropic APIGemini APILangChainHugging FaceProduct ManagementAgileScrumUser ResearchRoadmappingPRDsOKRs
Nice-to-have skills
PythonJavaScriptGitJiraConfluenceFigmaPostmanSwaggerREST APIGoogle Analytics
Domain expertise
biotechhealthtechai
Benefits & perks
healthcare coverage, annual incentive program, retirement benefits
Tech stack
PythonJavaScriptNLPLLMsOpenAI APIAnthropic APIGemini APILangChainHugging FaceGitLinuxJiraConfluenceFigmaPostmanSwaggerREST APIGoogle AnalyticsGA4Looker StudioWorkdayGreenhouseLeverMarketoExcelPowerPoint