Pillar: Evaluation
-
Contract Tutors
Contract Tutors examines whether AI can answer student questions as reliably as law professors, especially when answers depend on reasoning rather than recall. In the blinded study, contracts professors compared AI-generated and faculty-written responses to questions students commonly bring to office hours. The professors preferred the AI responses in roughly three-quarters of the comparisons, including…
-
JudgmentBench
In law and other judgment-rich domains, quality can be easier to recognize than to define. Is expert judgment more like a science, where quality can be broken into explicit criteria, or more like an art, where experienced practitioners can see what works even when they cannot fully explain why? JudgmentBench asks which of two methodologies–rubrics…