Senior Python Engineer - AI Code Evaluation (Codex / Claude Code)
G2i Inc.Technical Recruiting company
Miami, United StatesSenior
Data & AI
About the role
TL;DR
Evaluate AI coding agent interactions for engineering judgment and quality.
- •We are seeking highly experienced software engineers to evaluate the quality of interactions with modern coding agents like OpenAI Codex and Claude Code.
- •This role focuses on assessing an AI's engineering judgment rather than traditional code writing.
- •Key Responsibilities Evaluate AI-generated coding interactions end-to-end.
- •Judge the usefulness, correctness, and alignment of AI outputs with strong engineering principles.
- •Assess the quality of explanations and reasoning provided by AI models.
- •Provide clear, opinionated feedback on AI interaction quality.
- •Help define what constitutes excellent AI interaction for coding tools.
- •Requirements Staff/Principal-level engineer experience.
- •Strong background in TypeScript/JavaScript or Python.
- •Hands-on experience with OpenAI Codex, Claude Code, or Cursor.
- •Deep familiarity with modern AI-assisted development workflows.
- •Ability to evaluate code without deep execution or line-by-line review.
- •Comfortable giving direct, opinionated feedback.
- •High bar for "good engineering" standards.
Required skills
PythonOpenAI APIAnthropic API
Nice-to-have skills
TypeScriptJavaScript
Domain expertise
aideveloper-tools
Tech stack
PythonTypeScriptJavaScriptOpenAI APIAnthropic API