What happened
A Stanford Law School study, led by Professor Julian Nyarko, found that law professors preferred AI-generated answers to student questions over those written by their peers in 75% of nearly 3,000 blind comparisons. The research, involving 16 law professors from various U.S. law schools, focused on contract law questions requiring nuanced reasoning, not just factual recall. AI responses were flagged as pedagogically harmful in only 3.5% of cases, compared to 12% for human-written answers, indicating AI's capability in judgment-rich fields.
Why it matters
Legal education models face re-evaluation as AI demonstrates capability in nuanced reasoning, challenging prior assumptions about its limitations to clear-cut answers. For legal educators and curriculum designers, this shifts the focus from AI's accuracy to its responsible integration into judgment-rich fields. Procurement teams evaluating educational technology must now consider AI tutors as viable, high-quality options for complex subjects, potentially reducing the pedagogical risk associated with human-generated content.
