The Legal Beat
It Turns Out ChatGPT Wouldn’t Be The Best Law Student…
Posted on Thursday January 26, 2023
Alone, ChatGPT would be pretty mediocre law student. The bigger potential for the profession here is that a lawyer could use ChatGPT to produce a rough first draft and just make their practice that much more effective.
— Professor Jonathan Choi of the University of Minnesota Law School, in comments given to Reuters, on how the ChatGPT AI program would perform in law school. In a recent study, Choi collaborated with professors Kristin Hickman, Amy Monahan, and Daniel Schwarcz to see how ChatGPT would generate answers on four Minnesota Law exams that they blindly graded along with the exams of real students. On average, ChatGPT performed at the level of a C+ student after completing 95 multiple choice questions and 12 essay questions. ChatGPT performed the best in Constitutional Law (B), the second best in Employee Benefits (B-), and the worst in Torts (C-) and Tax (C-).
Staci Zaretsky is a senior editor at Above the Law, where she’s worked since 2011. She’d love to hear from you, so please feel free to email her with any tips, questions, comments, or critiques. You can follow her on Twitter or connect with her on LinkedIn.
ADDITIONAL STORIES:
Professor Offers ‘F*#k You’ To Student Request
Posted on Friday January 27, 2023
Law Professor Amy Wax Complains Of ‘Rigid Orthodoxy Of Permissible Speech’ That Doesn’t Celebrate Her Saying America Needs ‘Fewer Asians’
Posted on Friday January 27, 2023
It Turns Out ChatGPT Wouldn’t Be The Best Law Student…
Posted on Thursday January 26, 2023
Law School Responds To Allegations Of Racism Against Visiting Professor
Posted on Thursday January 26, 2023
Harvard Helps Preserve Slave Quarters As Part Of Reckoning With Its Law School’s History
Posted on Thursday January 26, 2023
Yale Law School Had So Much Fun The First Time, They’ve Brought Recognized Hate Group Back To Campus!
Posted on Wednesday January 25, 2023
Harvard Law School Student Attacked While Assailant Hurled Slurs
Posted on Wednesday January 25, 2023
Law Schools Where Starting Salaries For Graduates Exceed Their Student Debt
Posted on Tuesday January 24, 2023
We’re Still Mad, Actually: An Open Letter To The Legal Profession From A COVID-19 Bar Examinee
Posted on Tuesday January 24, 2023
Students At Top Law School Decide Ranking Their Female Classmates By Their Attractiveness Is Acceptable
Posted on Monday January 23, 2023
Bar Exam Model Answer
Posted on Saturday January 21, 2023
Harvard Law Professors Caught Using Final Exams To Outsource Copaganda
Posted on Friday January 20, 2023
All Systems Go For The NextGen Bar Exam, But Don’t Expect Every State To Get On Board Right Away
Posted on Friday January 20, 2023
Demanding Reparations Because A Slavery Name Is No Longer Honored Is Beyond The Pale
Posted on Friday January 20, 2023
Stanford Law Student Proves That Fair Play Doesn’t Really Apply To The Police
Posted on Thursday January 19, 2023