Senior AI Interaction Evaluator (Codex/Claude)

About the role

We are seeking a senior software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on assessing the engineering judgment behind AI‑generated code, not on writing production code.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and alignment with strong engineering thinking.
• Assess explanations, reasoning, and overall interaction quality, distinguishing between different levels of response quality.
• Provide clear, opinionated feedback on what works, what doesn’t, and what feels off or misleading.
• Help define standards for great interactions with AI‑first development tools.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a high bar for good engineering.
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line and to give direct, opinionated feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Up to $200 USD per hour for US/Canada engineers, up to $150 EUR per hour for EU/Latam, up to $100 USD per hour for other locations.
• 10–20 hours per week, remote work.
• Contract through early May with possible extension.