AI Policy Reviewer (Remote)

About the role

We are looking for an AI Policy Reviewer to evaluate AI‑generated and user‑generated content, ensuring it meets our governance standards, regulatory requirements and responsible AI principles. Working remotely, you will act as a quality‑assurance gatekeeper, protecting model integrity by spotting safety risks, bias, misinformation and policy breaches.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness and alignment with community guidelines.
• Identify and document edge cases where policy interpretation is ambiguous, including over‑sensitive or under‑sensitive model behavior.
• Analyze data to uncover systematic flaws such as bias, hallucinations or policy gaps and report findings to product and engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and create high‑quality “golden set” prompts and responses for training.
• Participate in adversarial testing (red‑team) to attempt jailbreaks and expose vulnerabilities before product launch.
• Work closely with machine‑learning engineers to explain rating decisions and help adjust model behavior.

Required profile

• At least 3 years of experience in Trust & Safety operations, content policy, risk analysis or legal/compliance review.
• Deep knowledge of content moderation topics such as hate speech, harassment, misinformation and graphic violence.
• Proven ability to deconstruct complex AI outputs, detect logical flaws, hallucinations and subtle biases.
• Strong written communication skills to explain findings to engineers and policy experts.
• Emotional resilience to handle disturbing content and established self‑care strategies.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Proficiency with dashboards, spreadsheets and specialized review tools.