About this role
Role Overview
Help shape foundational generative AI models by turning ambiguous program requirements into precise, consistent instructions for human raters. You will support work spanning finance, retail, insurance, legal, and sports, creating guidance that improves the quality and reliability of AI training data.
Key Responsibilities
- Partner with research and program teams to convert ambiguous requirements into rater-ready instructions across multiple subject areas.
- Create clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including in edge cases.
- Review draft guidance for ambiguity, internal conflicts, and coverage gaps, then revise it until raters can use it without escalation.
- Translate domain-specific program specifications in finance, retail, insurance, legal, and sports into precise instructions for raters.
- Work with subject matter experts and program leads to maintain accuracy and consistency across guideline sets.
Qualifications
- At least 3 years of professional experience in linguistics, instructional design, technical writing, or a closely related field.
- Direct experience writing or refining guidelines or rubrics for human raters in a generative AI or RLHF context.
- Ability to work across multiple domains and turn domain-specific nuance into clear, unambiguous instructions.
- A demonstrated record of resolving ambiguity and contradictions in written specifications, including concrete before-and-after examples.
- Demonstrable career progression.
- Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.
Work Terms
- United States-based, hourly W-2 employment.
- Reliable weekday availability of at least 35 hours per week is required.
- The role may include placement with a leading AI lab as part of its extended workforce.
Compensation
$45 to $65 per hour.
Eligibility
Employment decisions are made without discrimination based on race, religion, color, national origin, sex, including pregnancy, childbirth, reproductive health decisions, or related medical conditions, sexual orientation, gender identity or expression, age, protected veteran status, disability, genetic information, political views or activity, or any other legally protected characteristic.