Research Engineer
AndoWorkforce Management company
San Francisco, United StatesMid
Slow Ventures
Gaingels
Blitzscaling Ventures
Zero Capital
Monochrome
Mana Ventures
Data & AI
About the role
TL;DR
Research Engineer at Ando, focusing on building evaluation from real data and running experiments that ship.
- •You'll be one of the first members of a small research team, working close to both the data and the product.
- •You'll build evaluation from real data, run experiments that ship, decide what we build versus who we partner with, and publish when we have something real.
- •Key Responsibilities Build evaluation from real data
- •Mine production workspace data into benchmarks and labeled datasets.
- •Run experiments that ship
- •Initial work happens on offline workspace data; the destination is production systems used by every Ando customer.
- •Decide what we build versus who we partner with
- •We won't do everything in-house.
- •Part of the job is evaluating frontier vendors and research teams.
- •Publish when we have something real
- •We expect the team to publish as we make meaningful progress.
- •Requirements Strong applied research background, with depth in model evaluation, benchmarking, and/or failure analysis.
- •Evidence over credentials.
- •Work samples or code that demonstrate the skills: eval frameworks, benchmark suites, failure-analysis reports or tooling, labeling infrastructure.
- •Strong technical communication.
- •You can explain complex ideas simply and hold high-bandwidth, generative technical conversations.
- •Comfort with mess.
- •Real workspace data is incomplete, ambiguous, and full of edge cases that break clean abstractions.
- •Bonus: familiarity with simulation, human-in-the-loop evaluation, Cartridges and related context/memory-compression work, memory for multi-party long-running settings, or agent observability standards.
Required skills
PythonTensorFlowscikit-learnPandasNumPyAirflowKubernetesCI/CDGitJiraConfluencePostmanSlackAsanaLinear
Nice-to-have skills
TensorFlowscikit-learnPandasNumPyAirflowKubernetesCI/CDGitJiraConfluence
Domain expertise
ai
Benefits & perks
Free Equinox membership & other health perks, Generous equity grant vested over 4 years, Health, dental, vision insurance
Tech stack
PythonTensorFlowscikit-learnPandasNumPyAirflowKubernetesCI/CDGitJiraConfluencePostmanSlackAsanaLinearExcelPowerPoint