Lead Assessment Developer
OutsmartAI in company
On-site$120K - $180KLead
Lightspeed Venture Partners
Khosla Ventures
Reach Capital
DST Global
Abstract
Latitud
Product
About the role
TL;DR
Lead assessment development lifecycle, from item authoring to reporting, and shape AI integration.
- •Outsmart is seeking a Lead Assessment Developer to manage the full assessment development lifecycle, from item authoring to reporting.
- •You will work with psychometricians, faculty, product managers, and engineers to build scalable assessments and shape the use of AI in development workflows.
- •Key Responsibilities Manage end-to-end assessment development operations.
- •Develop and manage the SME network.
- •Lead standard-setting studies and facilitate panels.
- •Oversee vendor relationships and field testing operations.
- •Manage scoring operations for various assessment types.
- •Requirements Master's degree (Ph.D. preferred) in educational measurement, assessment, or a related field. 3+ years managing operational, high-stakes assessment lifecycles.
- •Proven experience leading standard-setting studies and managing SME panels.
- •Experience managing external vendors for field tests and pilot studies.
- •Working knowledge of validity, reliability, and fairness standards.
Required skills
PythonSQLProduct ManagementProject Management
Nice-to-have skills
LangChainOpenAI APIAnthropic APIGemini API
Domain expertise
edtechai
Benefits & perks
Competitive salary, Equity, Health insurance, Dental insurance, Vision insurance, Parental leave, PTO, Winter break, Paid company holidays, Remote work days, Lunch provided in-office
Tech stack
PythonJavaScriptTypeScriptSQLLangChainOpenAI APIAnthropic APIGemini API