Legal Fellow, AI Model Evaluation (Remote, US) — Human Frontier Collective

Scale AI
Remote — United States (US work authorization required) Contract Oct 26, 2026 AI traininglegal AIattorney1099 contractorScale AI
Project-based

About the role

Lawyers and upper-level law students can join Scale AI's Human Frontier Collective to test how advanced AI models handle legal work. The fellowship has you build realistic legal scenarios, grade model output for accuracy and regulatory fit, and write targeted feedback across compliance, litigation, case law and contract analysis. It is remote 1099 contract work with an expected six-month term, possible extension, and a self-set schedule of 10–40 hours a week. Pay is set per project and is not listed in the posting.

Responsibilities

  • Design realistic legal scenarios that probe how AI models reason
  • Grade model output for legal accuracy and alignment with regulations
  • Write targeted feedback on compliance, litigation, case law and contract analysis tasks
  • Join partner AI lab projects as you are invited to them
  • Optionally co-author research and technical reports with Scale's research team

Requirements

  • JD or LLM, or currently in the 2L/3L year of law school
  • Bar admission in any jurisdiction strongly preferred
  • Experience such as attorney, associate, legal analyst, law clerk, in-house counsel, legal researcher or law professor
  • Strong legal research, regulatory analysis, case law interpretation and brief writing
  • Authorized to work in the United States (no visa sponsorship)
  • Selection includes a short skills challenge and an interview; applicants who are turned down wait 90 days to reapply

What we offer

  • Fully remote with a flexible 10–40 hour week
  • About six months of work with potential to extend
  • Access to Scale's network of researchers and domain experts
  • Chance to be credited on published AI research
Project-based Apply now