Trending...
- The 2025 ESPY Awards After Party- Presented by Poppi & High Noon
- General Auction Company Announces August 8th Auction- Now Accepting Consignments
- $53 Million Company Valuation Investment with Majority Acquisition Option, Plus New Stock CUSIP Supporting Brand Transition of Fan Engagement Company
Download
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
- Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
- Laube Titanium to Attend MADE Bike Show in Portland, Oregon
- A Century of Compassion: Butte Humane Society Hosts 114th Anniversary Gilded Garden Gala
- United Set to Hire More Special Olympics Athletes As Customer Service Ambassadors
- Exelon Leader Tamla Olivier Named 2025 Technologist of the Year by Waves of Change STEM Conference
- KIDZ BOP RELEASES BRAND NEW ALBUM 'KIDZ BOP 51' FEATURING HITS "APT" & "PINK PONY CLUB"
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
- Be Part of the World's Largest Art Biennale | Moons, Castles, Trees | Copenhagen Chronotopes
- California sends more search and rescue crews to Texas
- YourEggs Is Leading the Way in Providing Access to the Best Asian Egg Donors to Families Worldwide
- California: Governor Newsom and Acting Governor Kounalakis honor fallen CDCR Parole Agent
- California sues to stop Trump's politically motivated attack on high-speed rail
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Filed Under: Business
0 Comments
Latest on The Californer
- WonderDays Launches the UK's First AI Experience Gift Finder – Gifting Just Got So Much Easier!
- CelluHeal™ Launches Full Line of Advanced Wound Dressings for Online Purchase in the USA, Canada, and Beyond
- California: Governor Newsom responds to Trump's latest gift to China: Defunding America's only high-speed rail
- California: Governor Newsom announces appointments 7.16.25
- California: Governor Newsom calls on Trump to end Los Angeles militarization, shares community resources
- City of Long Beach to Host Compost and Recycling Ambassador Program
- AMAZON DRIVERS IN CITY OF INDUSTRY JOIN THE TEAMSTERS
- Silva Construction Details Common Home Renovation Mistakes and How to Avoid Them
- Governor Newsom invites LA Fire survivors to continue shaping rebuilding efforts through Engaged California
- DOGUE Magazine and CoverDogs Announce Series A to Redefine Modern Pet Culture
- Voices for Humanity Treks High into the Himalayas to Deliver the Way to Happiness with Meena Sharma
- Nonprofit innovator named Mensa Executive Director
- Following Trump cut to LGBTQ youth suicide hotline, California steps up to fill the gap
- Yasmine Roulleau named Managing Director in Vancouver, Canada
- Chasing Elizabeth Taylor — The Dazzling True Story Behind the Queen of Diamonds Now Available in Limited-Edition Hardcover
- Swim Up Hill Animation Premieres Pilot Episode of "The Adventure of Swim Up Hill"
- LOS ANGELES TEAMSTERS AT METRO TRANSIT RATIFY FIRST CONTRACT
- Calmwater Capital Funds $22.8 Million Loan to Refinance Retail Complex in Park City
- From Barrio to Transgender Pioneer: Chapter 14 Personal Injustices Faced by the Protagonist
- Blacksmith InfoSec and Liongard Launch Strategic Integration to Simplify MSP Compliance Audits