California Bar discloses AI was used to develop questions in Exam
By AP Staff
A photo taken on November 27, 2024 shows the logo of the ChatGPT application developed by US artificial intelligence research organization OpenAI on a smartphone screen (L) and the letters AI on a laptop screen in Frankfurt am Main, western Germany. (Photo by Kirill KUDRYAVTSEV / AFP) (Photo by KIRILL KUDRYAVTSEV/AFP via Getty Images)
LOS ANGELES (AP) — The State Bar of California has disclosed that some multiple-choice questions in a problem-plagued bar exam were developed with the aid of artificial intelligence.
The legal licensing body said in a news release Monday that it will ask the California Supreme Court to adjust test scores for those who took its February bar exam.
“The debacle that was the February 2025 bar exam is worse than we imagined,” Mary Basick, assistant dean of academic skills at the University of California, Irvine, Law School, told the Los Angeles Times. “I’m almost speechless. Having the questions drafted by non-lawyers using artificial intelligence is just unbelievable.”
In February, the new exam led to complaints after many test-takers were unable to complete their bar exams. The online testing platforms repeatedly crashed before some applicants even started. Others struggled to finish and save essays, experienced screen lags and error messages and could not copy and paste text, the Times reported earlier.
According to a recent presentation by the State Bar, 100 of the 171 scored multiple-choice questions were made by Kaplan and 48 were drawn from a first-year law students exam. A smaller subset of 23 scored questions were made by ACS Ventures, the State Bar’s psychometrician, and developed with artificial intelligence.
“We have confidence in the validity of the (multiple-choice questions) to accurately and fairly assess the legal competence of test-takers,” Leah Wilson, the State Bar’s executive director, told the newspaper in a statement.
Katie Moran, an associate professor at the University of San Francisco School of Law who specializes in bar exam preparation, told the newspaper, “It’s a staggering admission.”
“The State Bar has admitted they employed a company to have a non-lawyer use AI to draft questions that were given on the actual bar exam,” she said. “They then paid that same company to assess and ultimately approve of the questions on the exam, including the questions the company authored.”
Andrew Perlman, dean of Suffolk University Law School and an advisory council member of the American Bar Association Task Force on the Law and Artificial Intelligence, said he had not heard of AI being used to develop bar exam questions or standards being put in place governing such uses.
But he said he was not surprised, given the rapid growth of AI technology. Perlman said AI can be useful for developing questions for assessment, but a critical guard rail is making sure that everything that comes from an AI tool is vetted carefully by experts in the subject matter.
He expects its use to continue to grow.
Although there might be public skepticism of the emerging technology in the legal profession at this time, “we will be worried in the future about the competence of lawyers who don’t use these tools,” Perlman predicted.
Julie Hansen of Babbel unveils Babbel Speak, an AI voice trainer tackling language fear head-on, as Babbel eyes IPO and takes on AirPods’ translation tech.
The Trump administration has issued its first warnings to online services that offer unofficial versions of popular drugs like the blockbuster obesity treatment Wegovy.
Albania's Prime Minister Edi Rama says his new Cabinet will include an artificial intelligence “minister” in charge of fighting corruption. The AI, named Diella, will oversee public funding projects and combat corruption in public tenders. Diella was launched earlier this year as a virtual assistant on the government's public service platform. Corruption has been a persistent issue in Albania since 1990. Rama's Socialist Party won a fourth consecutive term in May. It aims to deliver EU membership for Albania in five years, but the opposition Democratic Party remains skeptical.
The Federal Trade Commission has launched an inquiry into several social media and artificial intelligence companies about the potential harms to children and teenagers who use their AI chatbots as companions.
Swedish buy now, pay later company Klarna is making its highly anticipated public debut on the New York Stock Exchange Wednesday, the latest in a run of high-profile initial public offerings this year. The offering priced at $40 Tuesday, above the forecasted range of $35 to $37 a share, valuing the company at more than $15 billion. The valuation easily makes Klarna one of the biggest IPOs so far in 2025, which has been one of the busier years for companies going public. Other popular IPOs so far this year include the design software company Figma and Circle Internet Group, which issues the USDC stablecoin..
Oracle co-founder Larry Ellison wrested the title of the world’s richest man from longtime holder Elon Musk early Wednesday as stock in his software giant rocketed more than a third in a stunning few minutes of trading. That is according to wealth tracker Bloomberg. A college dropout, the 81-year-old Ellison is now worth $393 billion, Bloomberg says, several billion more than Musk, who had been the world’s richest for four years. The switch in the ranking came after a blockbuster earnings report from Oracle. Forbes still has Musk as the richest, however, valuing his private businesses much higher.
Online broker Robinhood Markets will join the S&P 500 index Online broker Robinhood Markets will join the S&P 500 index as its stock rides higher on a cryptocurrency wave.
Ali Kashani, CEO of Serve Robotics, dives into their $63.3M acquisition of Vayu Robotics and how it's accelerating the future of autonomous delivery systems.
