Senior Software Engineer - AI Interaction Evaluator
G2i Inc.Technical Recruiting company
MiamiSenior
Data & AI
About the role
TL;DR
Evaluate AI-generated coding interactions and provide feedback.
- •Evaluate AI-generated coding interactions end-to-end, focusing on whether the response makes sense, the preamble and reasoning are useful, and the output reflects strong engineering judgment.
- •Key Responsibilities Evaluate AI-generated coding interactions Judge whether outputs are useful, correct, and aligned with strong engineering judgment Assess the quality of explanations and reasoning Provide clear, opinionated feedback on what worked, what didn't, and what felt off or misleading Help define what 'great' looks like when interacting with tools like Cursor Requirements Staff / Principal-level engineer (or equivalent experience) Strong background in TypeScript / JavaScript or Python Hands-on experience using OpenAI Codex, Claude Code, and Cursor Deep familiarity with modern AI-assisted dev workflows Able to evaluate code without needing to fully execute or deeply review every line Comfortable giving direct, opinionated feedback High bar for what 'good engineering' looks like
Required skills
TypeScriptJavaScriptOpenAI APIAnthropic APIEngineering ManagementTechnical Leadership
Nice-to-have skills
A/B TestingProduct ManagementAgileScrumKanbanUser ResearchDesign ThinkingPrototypingProject Management
Domain expertise
ai
Tech stack
TypeScriptJavaScriptOpenAI APIAnthropic API