Applied AI Data Analyst
ConfidoFinancial Automation company
New York, United StatesMid
Y Combinator
Footwork
Watchfire Ventures
Boulder Food Group
The Fintech Fund
Barrel Ventures
Data & AI
About the role
TL;DR
Analyze financial and operational data to evaluate AI models and improve customer insights.
- •As an Applied AI Data Analyst, you will bridge the gap between massive, unstructured financial and operational datasets and our core R&D team.
- •You will own the evaluation platform of our agentic workflows forecasting pipelines and improve customer-facing insights.
- •Key Responsibilities Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for LLM-driven systems.
- •Dig deep into complex datasets to determine why extraction or time-series models succeeded or failed.
- •Define, curate, and maintain gold-standard evaluation datasets for AI agents and demand forecasting models.
- •Build dashboards and evaluation harnesses to monitor system health and AI performance metrics.
- •Partner with applied AI engineers, product managers, and business operations managers.
- •Requirements Graduate degree (M.S. or Ph.D.) in a STEM field. 2-4 years of experience in a quantitative data analyst or AI evaluation role.
- •Proficiency in Python and hands-on work with AI/ML models.
- •Strong capabilities with SQL and enterprise data infrastructure (PostgreSQL, Snowflake, dbt, AWS).
- •Exceptional ability to translate noisy, unstructured document data into rigorous evaluation insights.
Required skills
PythonSQLPostgreSQLSnowflakedbtAWS
Nice-to-have skills
LLMsNLP
Domain expertise
aiproductivity
Benefits & perks
Equity, Fully paid health coverage, Top-tier dental and vision coverage, Carrot Fertility Pro, 12 weeks of paid parental leave, Unlimited PTO, 401(k), Paid relocation support, Fully equipped workspace, Team perks
Tech stack
PythonSQLPostgreSQLSnowflakedbtAWS