Legal Counsel for AI Model Evaluation

Role Overview

Apply senior legal judgment to help a leading AI research organization improve how advanced AI models reason about real-world legal work. You will work closely with research and program management teams to define high-quality legal tasks, standards, and evaluations. This role is designed for a practicing legal specialist with deep subject-matter expertise, not a generalist.

Key Responsibilities

• Review legal knowledge-work tasks and model outputs, identifying missing behaviors, weak reasoning, and responses that would not withstand professional legal scrutiny.
• Write detailed instruction specifications and model solutions that establish standards for correct legal analysis.
• Create legal problems and tasks that reflect real practice.
• Design rigorous benchmarks and evaluation sets to measure model improvement.
• Partner with researchers and adjacent-domain specialists to build legal-focused skills and tools.
• Translate professional legal judgment into clear, teachable criteria and maintain consistent quality standards.

Qualifications

• Juris Doctor from an accredited law school; graduation from a highly ranked law school is strongly preferred.
• At least 5 years of substantive post-qualification legal practice with a reputable law firm, corporate legal department, regulatory body, or court. Internships and clerkships alone do not qualify.
• Specialization in at least one substantive legal area, such as corporate and transactional law, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labor, or tax.
• Demonstrated progression to a senior role, including partner, of counsel, counsel, senior associate, senior in-house counsel, or general counsel, with meaningful ownership of legal matters.
• Active admission to at least one U.S. state bar and good standing.
• Hands-on professional use of large language models and the ability to distinguish sound legal reasoning from plausible but incorrect answers.
• Excellent written communication skills and the ability to provide precise, well-structured feedback.

Work Terms

• Full-time, hourly W-2 employment.
• Hybrid role based in the Bay Area, California. Candidates must live in the Bay Area and work on-site with the client team multiple days per week when required; this is not a remote role.
• Candidates outside the Bay Area must be willing to relocate at their own expense before starting. Relocation assistance is not available.
• Client-issued accounts and equipment will be provided, and work will be performed in the client’s tools alongside its research teams.
• This is a structured role integrated with the client team and standard enterprise workflows, not a freelance engagement.

Compensation

$100 to $150 per hour.

Eligibility

The employer of record administers employment, payroll, benefits, compliance, and related onboarding for this role. Equal employment opportunity is provided without discrimination based on legally protected characteristics, and reasonable accommodations are available for qualified individuals with disabilities and disabled veterans throughout the application process.