Written Assessment Reviewer
Job Description
Use experience grading written work to assess the reliability and usefulness of AI responses.
What you will do
• Compare responses for clarity, tone, usefulness and compliance with instructions.
• Apply rubrics and write a reasoned explanation for each score.
• Identify fluent but unsupported claims and answers that fail their intended audience.
• Document factual errors, inconsistencies and other reliability problems.
• Keep careful records and calibrate judgments asynchronously.
Preferred background
• First-language or equivalent written English and a completed degree from an accredited institution in the US, Canada, UK, Ireland, Australia or New Zealand.
• Experience marking or examining written work using established criteria.
• Assessment/instructional design, peer review, thesis supervision or academic-writing support.
• Objective analysis and clear feedback; RLHF or annotation experience is optional.
Location and eligibility
• Remote; the countries specify preferred educational background, not required residence.
Availability
• Hours and duration are agreed before work; no fixed commitment is stated.
Pay and engagement
$95 • $147/hr
USD hourly compensation. The applicable rate and agreed work scope are confirmed before work begins.