Trending...
- California: Governor Newsom, Superintendent Thurmond announce over $618 million to support another 458 community schools
- $4.3 Million Patent Application Waiver Fee Granted by FDA on New Drug Application Fee for Treatment Addressing Suicidal Depression & PTSD: NRX Pharma
- xREnergy up as much as +3,094,634% on first day listed on the XRP Ledger. Ticker : $XRE
Download
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
- Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
- Bennett Awards Designs Two Cohesive Custom Awards for 2025 Sci-Tech Academy Awards
- Poll Finds Overwhelming Opposition to Keeping Big Cats as Pets
- SM Telecom Expands AT&T Partnership to Deliver Cutting-Edge 5G+ Wireless Solutions New Collab Brings AT&T's Advanced 5G+ Technology to Cellphone
- Governor Newsom proclaims Older Californians Month
- Groundbreaking Launches 154-Acre Los Cerritos Wetlands Restoration in Long Beach – Single Largest Increase in Open Space in Long Beach in Decades
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
- Don Barnhart Drops Unapologetically Hilarious Comedy Special "You Do You," On Open Bar Network
- Cygnet Theatre Announces The Cast and Creative Team of Rodgers and Hammerstein's Oklahoma!
- Shon Garage Door Repair Expands Trusted Services to San Diego, CA
- Nicky Dare Honors Indonesian Heritage at VAPI–Valley Asian and Pacific Islanders Cultural Festival
- California launches new AI-powered chatbot that provides wildfire resources in 70 languages
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Filed Under: Business
0 Comments
Latest on The Californer
- Gravity to Bring 5-Minute EV Charging to 8 Sites Across Greater LA
- California: Governor Newsom issues statement on Pope Leo XIV, the first American Pope
- New poll shows high rates of employee burnout amid concerns over politics and personal finances
- Tessellations Appoints Luthern Williams as Head of School
- Aureli Construction Sets the Standard for Seamless Home Additions in Greater Boston
- Psychological Thriller "Killing Off Connor" To Open 34th IFS Film Fest After 12-years In Post
- Harvest Properties Acquires Two San Francisco Bay Area Self Storage Facilities for $44.2 Million
- California businesses in near-universal compliance with prohibition of intoxicating hemp products harmful to youth
- California: Governor Newsom announces upgrades to 21 state fish hatcheries to boost salmon populations
- Solaris Energy Infrastructure, Inc. (SEI) Investors Who Lost Money Have Opportunity to Lead Securities Fraud Lawsuit
- Risk Rater, Threat Assessment App, gives Users the Same Threat Evaluation as the Rich and Powerful
- Is it Really True That Tariffs Will Raise Car Insurance Rates?
- ScreenPoints Puts Film Investors in the Credits—and in the Money With New FinTech Platform
- Coastal Business Systems Wraps Up Successful 2025 Tech Show in Redding
- AdOcto Turns AirBnBs Into High-Impact Advertising Channels
- Zefr Announces Launch of Pre-Screen Brand Safety Solution for Google's Search Partner Network (SPN)
- Pathways to Adulthood Conference May 17 at Melville Marriott Honoring NYS Assembly Member Jodi Giglio, Suffolk County Legislator Nick Caracappa
- Adster Techologies awarded US Patent for breakthrough innovation in reducing latency in Ad Serving
- Flexi-View Lending Closes $5.05 Million Residential Acquisition Loan in Billings, Montana
- Robert Fabbio Inducted into the Austin Technology Council Hall of Fame