In-House Counsel for Australian Law AI Evaluation

Role Overview

Apply your Australian in-house legal expertise to help evaluate how AI systems respond to practical legal questions. You will test identical prompts in two AI platforms, assess the results against a provided rubric, and deliver concise written feedback.

Key Responsibilities

• Run the same legal prompts through two AI language-model platforms.
• Compare both responses side by side.
• Score each response using a standardized evaluation rubric.
• Submit concise written feedback for every evaluation.

Qualifications

• At least 5 years of experience as in-house legal counsel practising in Australia.
• Strong knowledge of Australian law, particularly commercial and contract matters.
• Excellent attention to detail and precise written English.
• Ability to work independently, follow a rubric, and meet deadlines.

Work Terms

• Remote role, open to candidates located in Australia.
• Hourly engagement.
• Initial commitment of approximately 10 hours, with potential for additional work.
• All work is subject to a non-disclosure agreement.

Compensation

• $100 to $120 per hour.