Senior Engineer - AI Interaction Evaluator
G2i Inc.Technical Recruiting company
Miami, United StatesSenior
Data & AI
About the role
TL;DR
Evaluate AI coding agent interactions, focusing on engineering judgment and quality.
- •We are seeking highly experienced software engineers to evaluate the quality of interactions with modern coding agents like OpenAI Codex and Claude Code.
- •This role focuses on assessing whether AI models 'think' like great engineers, rather than traditional code writing.
- •Key Responsibilities Evaluate AI-generated coding interactions end-to-end.
- •Judge the usefulness, correctness, and alignment of AI outputs with strong engineering judgment.
- •Assess the quality of explanations and reasoning provided by AI models.
- •Provide clear, opinionated feedback on AI performance and interaction quality.
- •Help define what constitutes excellent AI interaction in coding contexts.
- •Requirements Staff/Principal-level engineer experience.
- •Strong background in TypeScript/JavaScript or Python.
- •Hands-on experience with OpenAI Codex, Claude Code, and Cursor.
- •Deep familiarity with modern AI-assisted development workflows.
- •Comfortable giving direct, opinionated feedback and making subjective but rigorous judgments.
Required skills
PythonTypeScriptJavaScriptOpenAI APIAnthropic API
Domain expertise
developer-toolsai
Tech stack
PythonTypeScriptJavaScriptOpenAI APIAnthropic API