Mercor · Finance & specialist

SWE-Bench Task Auditor

Listed on Mercor as “SWE-Bench Task Auditor”

$70-$90/hrRemoteContractPaid in USD

Apply on Mercor

ShareWhatsApp Telegram Email

How this rate compares

This listing

$70–$90 per hour

Typical in Finance & specialist

$60–$100 per hour

Within the typical range

Typical: the middle of the lowest and highest rates posted by 345 listings in this category on Seoulstart, in US dollars.

What this actually is

You bring your specialist expertise to AI evaluation. The shape of the work varies but the pattern is the same: review outputs, rate quality, write prompts, flag errors. The platform title (SWE-Bench Task Auditor) reflects the rate band and the expertise required, not the day-to-day work.

How Mercor picks people

Upload your CV and answer the role's written questions.
Do a video interview with Mercor's AI interviewer. Most take about 20 minutes, in English unless the role says otherwise.
Some roles add a skills test. A test you pass once counts for similar roles.
The project team reviews your results and sends offers to the people it picks.

Before you start

Take Mercor's free practice interview first. It does not count toward any application.
Use Chrome on a computer with a camera and microphone, in a quiet room.
You can retake an official interview up to 3 times, but hiring teams see how many times you retook it.

Not every applicant gets an offer. Prepare well for the interview.

How to prepare for the Mercor interview

Source: Mercor's help pages. talent.docs.mercor.com

Can you do this on your visa?

F-2 / F-4 / F-5 / F-6: open. E-1 to E-7: needs concurrent-employment permit. D-2 / D-4 students: S-3 permit, 20 hr/week cap. D-10 / D-8: case by case.

Korean tax on USD income

First 5 years in Korea: foreign-source income only taxed if remitted into Korea. After year 5: worldwide income. Full tax guide.

Original posting from Mercor

Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll assess repository-level tasks, reference patches, test harnesses, and grading integrity - and provide clear, rubric-based written feedback.

Basic Qualifications

• 3+ years professional software engineering

• Real open-source contribution or maintainer experience (merged PRs, committer / maintainer roles)

• Strong ability to audit reference patches, test runners, and Docker isolation, and to detect answer leakage / reward hacking

• Fluency across common ecosystems (Python and at least one of Java / Go / TypeScript / C++)

Preferred Qualifications

• Familiarity with SWE-Bench (Verified) or similar repository benchmarks

• Maintainer history on major Python OSS (Django, Flask, scikit-learn, sympy, pytest, etc.)

• Prior code-review or task-grading experience

Quoted from Mercor's public listing on 2026-11-13. We don't edit platform copy; honest framing is in the title and the “what this actually is” block above.

Related AI training jobs

Alignerr · Finance & specialist

Finance Expert: AI Financial Reasoning Review

$60-$80/hr · Remote · USD

Mercor · Finance & specialist

Accounting Expert - review AI outputs in your specialty

$85/hr · Remote · USD

Mercor · Finance & specialist

Application Users - Linux Ubuntu 24.04 Expert - Professionals - review AI outputs in your specialty

$60-$70/hr · Remote · USD

Mercor · Finance & specialist

Application Users - macOS Sonoma 14.5 Expert - Professionals - review AI outputs in your specialty

$60-$70/hr · Remote · USD