AI passes bar exam, legal tech company's model gets 70% correct answers = Korea

Legal tech company Law & Company's self-developed artificial intelligence (AI) legal secretary "Super Lawyer" achieved a 74% correct answer rate in the multiple-choice test of the 14th Korean Bar Examination.
The company's previous best result was 53.3% in 2023, but this time it far exceeded that. 111 out of a total of 150 questions were answered correctly.
This exceeds the average number of correct answers (103) given by successful candidates in the multiple-choice test for the bar exam over the past five years.
It also exceeds the accuracy rate of the latest AI models such as "GPT-4.5 Claude 3.7 Sonnet".
When the same test questions were entered into the "Sonnet" and used for evaluation, the correct answer rate was only 49.3%.
Super Lawyer is a generative AI legal secretary service that the company began offering to lawyers in July 2024. It uses a large-scale language model (LLM) to
It uses the architecture developed by Law & Company, which has a vast amount of legal data, including 4.95 million legal precedents and legal data held by the company.
I studied about 600 law books published by Hakueisha, a publisher of law-related books.