About the Project

This project focuses on the technical review and validation of coding tasks used to train AI models. Coding challenges are generated automatically by AI, and your role is to evaluate quality of the challenge.

The core questions you will be answering on every task:

Are the requirements well defined?
Are the associated tests correctly validating the requirements?

Tests are treated as the mechanism of truth in this context. Mistakes here propagate at scale into AI systems — error criticality is high.

Languages

Tasks in this project involve code written across multiple languages. You will be expected to review and evaluate tasks in any of the following:

Python
JavaScript / TypeScript
Go
Rust
Java

Responsibilities

Evaluate whether the coding task itself is clearly and correctly defined
Validate whether tests accurately reflect whether the problem has been solved
Determine whether a solution that passes the tests genuinely solves the underlying problem
Apply strict technical criteria and quality standards consistently across tasks

Required Profile

This role is designed for mid/senior-level software engineers with real professional experience.

Technical requirements

Proven professional experience in software development (production environments)
Experience reviewing and evaluating code written by other engineers
Solid understanding of automated testing — how tests validate (or fail to validate) behavior
Experience contributing to or working with open source projects
High attention to detail and strong technical judgment
Comfortable working fully in English (reading and writing)

Nice to have

Experience with test-driven development (TDD) or test design
Familiarity with large or complex codebases

Project Details

This is expert, task-based technical work focused on analysis, validation, and judgment — not code production.

Compensation

USD 60-80 per hour.
~5-10 hours per week.

Ready to participate?

Start your paid interview now

About Terac

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Senior Software Code Reviewer