Trending...
- California: Three years after the end of Roe, Governor Newsom, First Partner sound the alarm on Trump's "Big, Beautiful" plan to defund Planned Parenthood - 121
- Ascent Solar Technologies Enters Collaborative Agreement Notice with NASA to Advance Development of Thin-Film PV Power Beaming Capabilities: ASTI - 103
- California awards over $15 million to apprenticeship programs connecting youth to high-paying jobs
Download
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
- Research from LegalOn Technologies indicates that GPT-4 can perform better than the average test taker on the legal ethics exam. (Graphic: Business Wire)
SAN FRANCISCO--(BUSINESS WIRE)--In a groundbreaking development, researchers at LegalOn Technologies have demonstrated that both OpenAI's GPT-4 and Anthropic's Claude 2 can pass the legal ethics exam, a test nearly all US lawyers are required to pass, alongside the bar exam. This milestone underscores the potential for AI to assist lawyers in legal work and demonstrates the increasingly advanced capabilities of large language models applied to law.
More on The Californer
- California: Governor Newsom proclaims Immigrant Heritage Month 2025
- California: Department of Defense agrees: it's time for Trump's militarization of Los Angeles to end
- Long Beach: City Launches Internet Service Enrollment Line
- Von Rock Law Founder Deidre Von Rock Named Super Lawyer for 2025
- California: Governor Newsom extends emergency short-term housing protections in Los Angeles
Earlier this year, research found that the generative AI model GPT-4 could surpass law students in passing the Uniform Bar Examination. LegalOn's study extends this discovery, revealing that these models can also navigate complex rules and fact patterns around professional responsibility. Ethics are part of many professional certifications, but their importance in law is highlighted by the standalone ethics exam that lawyers must pass.
LegalOn's research tested several leading generative AI models, including OpenAI's GPT-4, GPT-3.5, Anthropic's Claude 2, and Google's PaLM 2 Bison, on their ability to correctly answer questions modeled for the legal ethics exam, known as the Multistate Professional Responsibility Exam (MPRE). GPT-4 performed best, answering 74% of questions correctly, outperforming the average human test-taker by an estimated 6%. GPT-4 and Claude 2 both score above the approximate passing threshold for the MPRE in every state where it is required, a threshold estimated to range between 56-64% depending on the jurisdiction.
"This research advances our understanding of how AI can assist lawyers and helps us assess its current strengths and limitations," stated Daniel Lewis, US CEO of LegalOn. "We are not suggesting that AI knows right from wrong or that its behavior is guided by moral principles, but these findings do indicate that AI has potential to support ethical decision-making."
The MPRE consists of 60 multiple choice questions covering a broad range of topic areas, such as client confidentiality, conflicts of interest, and malpractice. For its study, LegalOn tested each large language model against 100 simulated exams composed of questions created by Professor Dru Stevenson, who teaches professional responsibility at South Texas College of Law Houston. Each large language model was tested using a "zero shot" approach, which involves no prior training about legal ethics.
"That AI can pass the legal ethics exam marks a turning point not only for legal technology but also for the practice of law," said Professor Stevenson. "The responsibility for ethical decisions will always remain firmly with legal professionals, but this study shows the potential for technology to assist the legal community with consistently meeting high ethical standards."
More on The Californer
- Von Rock Law Named SFGate's Best Probate and Estate Attorney in 2025
- Long Beach to Conduct Annual Summer Recess for City Council Meetings During July
- Plan to Launch Silo Technologies' Cybersecurity Pilot Program for Ultimate Nationwide Deployment via Exclusive Partnership: Stock Symbol: BULT
- Robert Michael & Co. Real Estate Team Celebrates Industry Recognition and Showcases Premier Central Florida Listings
- Montessori Stoppani Partners with Lifetime Montessori School
"Generative AI applied to legal work continues to surprise and impress. Today it is capable of tasks that, this time last year, seemed years away," said co-author Gabor Melli, VP of Artificial Intelligence at LegalOn Technologies. "This research indicates that it may be possible to develop AI to assist lawyers with ethical compliance and operate, where relevant, in alignment with lawyers' professional responsibilities."
GPT-4's performance varied by subject area, and there are opportunities for improvement. It performed particularly well in areas such as conflicts of interest and client relationships, and less well on topics such as the safekeeping of funds. These findings indicate that performance may improve with more domain-specific knowledge and lawyer-led training and validation. This research reaffirms LegalOn's belief in the importance of integrating expert legal content and knowledge with AI systems to build professional-grade tools. Earlier this year, LegalOn launched AI Revise, the first AI contract editor enhanced by expert legal knowledge, enabling legal teams to make precise, context-aware contract revisions with one click.
For a deeper insight into this study and its implications, download a copy of the report here.
About LegalOn Technologies
LegalOn Technologies is the leading AI contract review software for legal teams, serving innovative lawyers and legal professionals at over 4,000 companies and firms globally. The company is backed by leading investors and has raised over $130M. Companies and firms interested in our technology can find more information and sign up for a demo at LegalOnTech.com (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.legalontech.com%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LegalOnTech.com&index=5&md5=7f9d1a20d49bd48b79df99b4663628c0). LegalOn's US headquarters are in San Francisco, and its global headquarters are in Tokyo. Follow LegalOn on LinkedIn (https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Flegalon-technologies%2F&esheet=53843035&newsitemid=20231116912443&lan=en-US&anchor=LinkedIn&index=6&md5=0ddf8c051098d5bcac6f55c267c497fc) to stay up to date on the latest news and developments.
Contacts
Corey Longhurst | info@legalontech.com
0) { // Create container for hi-res image jQuery('#bw-release-hires').append('
'); }; }); ]]>
Contacts
Corey Longhurst | info@legalontech.com
Filed Under: Business
0 Comments
Latest on The Californer
- Spartan & Guardians Partner with Guitar Legend Buckethead to Support Global Child Rescue Efforts
- Preliminary.online Introduces Short-Term Job-Readiness Courses with Employer-Verified Certifications
- Psychologist-Turned-Hermeticist Releases Modern Guide to the Seven Hermetic Principles
- Winners Announced for Asia Pacific Business Awards 2024-2025
- Hamvay-Lang and Lampone.hu Join Forces with AIMarketingugynokseg.hu to Elevate Hungarian Lifestyle Brands on the Global Stage
- Google AI Quietly Corrects the Record on Republic of Aquitaine's Legal Sovereignty
- California: El Gobernador Newsom firma un presupuesto estatal equilibrado que reduce los impuestos a los veteranos, financia completamente las comidas escolares gratuitas, construye más viviendas y crea empleos
- California: Governor Newsom signs balanced state budget that cuts taxes for vets, fully funds free school meals, builds more housing, & creates jobs
- California: Governor Newsom announces appointments 6.27.25
- NYC Leadership Strategist Stacie Selise Launches Groundbreaking 4S Framework Series to Redefine Executive Excellence
- Baby Boomer Housing Trend: Big Homes Out, Simplicity In
- Governor Newsom slams Trump over bill that would cut millions in health coverage, food assistance for California
- Jamison & Tania Events Wins Dual California Wedding Day Magazine "Best of 2025" Awards
- California invests billions of dollars to fix roads with "gas tax," expand bus and train service
- Long Beach: City Offering Space Beach Youth Workforce Summer Camp to Inspire Next Generation of Aerospace Professionals
- Make Innovation Matter: Support H.R.1's R&D Expensing Relief for American Small Businesses
- California: Governor Newsom statement on nationwide injunctions
- City of Long Beach Facilities and Services Schedule for Independence Day
- Agreement to Supply US-Based Defense Provider with Thin-Film Solar Tech for Orbital Application; Ascent Solar Technologies, Inc. (N A S D A Q: ASTI)
- Introducing The AI Bleederboard™