Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
G2i Inc.Technical Recruiting company
Miami, United StatesSenior
Data & AI
About the role
TL;DR
Evaluate AI coding agent interactions for engineering judgment and reasoning quality.
- •Senior AI Interaction Evaluator (Codex / Claude Code) We’re looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.
- •This is not a traditional engineering role.
- •You won’t be writing production code.
- •You’ll be evaluating something harder: whether the model thinks like a great engineer.
- •About the Role This role involves evaluating the quality of interactions with AI coding agents like OpenAI Codex and Claude Code, focusing on whether the AI exhibits strong engineering judgment and reasoning.
- •Key Responsibilities Evaluate AI-generated coding interactions end-to-end.
- •Judge the usefulness, correctness, and alignment of AI outputs with strong engineering thinking.
- •Assess the quality of explanations and reasoning provided by AI models.
- •Provide clear, opinionated feedback on AI interaction quality.
- •Help define what constitutes excellent AI-assisted engineering interactions.
- •Requirements Staff / Principal-level engineer (or equivalent experience).
- •Strong background in TypeScript/JavaScript or Python.
- •Hands-on experience using OpenAI Codex, Claude Code, and Cursor.
- •Deep familiarity with modern AI-assisted dev workflows.
- •Comfortable giving direct, opinionated feedback.
- •High bar for what “good engineering” looks like.
Required skills
TypeScriptJavaScriptPythonOpenAI APIAnthropic API
Domain expertise
developer-toolsai
Tech stack
PythonTypeScriptJavaScriptOpenAI APIAnthropic API