Research Engineer
FirecrawlAI & company
San Francisco, United States$210K - $275KSenior
Y Combinator
Nexus Venture Partners
Zapier
Tobias Lütke
Abhinav Asthana
Matt McClure
Data & AI
About the role
TL;DR
Design and implement evaluation systems for measuring the quality of AI-generated data.
- •Design metrics, build pipelines, generate datasets, and own the feedback loop from output quality back to model and product decisions.
- •Key Responsibilities Design metrics for evaluating output quality Build pipelines and harnesses for rigorous evaluation Generate and curate datasets for trustworthy evaluation Own the feedback loop from output quality to model and product decisions Turn 'did that work?' into an actionable answer for the team Requirements 4+ years in ML, research engineering, or data-heavy backend Real evaluation work experience Engineering depth to build evaluation systems Passion for defining and measuring 'good'
Required skills
PythonTensorFlowscikit-learnKubernetesCI/CDAirflowPostgreSQLAWS
Domain expertise
ai
Benefits & perks
Equity
Tech stack
PythonTensorFlowscikit-learnKubernetesCI/CDAirflowPostgreSQLAWS