AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. Working remotely, you will ensure that content meets accuracy, clarity, factual integrity, brand standards, and safety guidelines.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, toxicity, bias, and factual correctness.
• Create high‑quality training datasets by labeling data according to strict annotation guidelines.
• Audit the work of junior reviewers or automated systems to maintain consistency with project rubrics.
• Collaborate with operations teams to refine style guides and annotation instructions.
• Identify recurring model errors and provide detailed feedback to data scientists and engineers.
• Monitor basic performance metrics such as Inter‑Agreement Rates and F1 scores.

Required profile

• Minimum 2 years of professional experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Strong analytical ability to make reasoned judgments under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience testing or providing feedback on generative AI models (e.g., ChatGPT, Bard, Midjourney).
• Background in linguistics, data annotation, or computational linguistics is a plus.
• Ability to thrive in a fast‑paced, evolving environment.

Required skills

• Familiarity with generative AI models such as ChatGPT, Bard, Midjourney.
• Proficiency with data annotation tools and spreadsheet software.
• Ability to calculate and interpret metrics like F1 score and Inter‑Agreement Rate.