California Prosecutor Says AI Caused Errors in Criminal Case; Sacramento Bee via Government Technology, November 7, 2025

Sharon Bernstein, Sacramento Bee via Government Technology; California Prosecutor Says AI Caused Errors in Criminal Case

"Northern California prosecutors used artificial intelligence to write a criminal court filing that contained references to nonexistent legal cases and precedents, Nevada County District Attorney Jesse Wilson said in a statement.

The motion included false information known in artificial intelligence circles as “hallucinations,” meaning that it was invented by the AI software asked to write the material, Wilson said. It was filed in connection with the case of Kalen Turner, who was accused of five felony and two misdemeanor drug counts, he said.

The situation is the latest example of the potential pitfalls connected with the growing use of AI. In fields such as law, errors in AI-generated briefs could impact the freedom of a person accused of a crime. In health care, AI analysis of medical necessity has resulted in the denial of some types of care. In April, A 16-year-old Rancho Santa Margarita boy killed himself after discussing suicidal thoughts with an AI chatbot, prompting a new California law aimed at protecting vulnerable users.

“While artificial intelligence can be a useful research tool, it remains an evolving technology with limitations — including the potential to generate ‘hallucinated’ citations,” Wilson said. “We are actively learning the fluid dynamics of AI-assisted legal work and its possible pitfalls.”

Justice Department ends limiting compassionate release in plea deals after NPR story; NPR, March 11, 2022

 Carrie Johnson, NPR; Justice Department ends limiting compassionate release in plea deals after NPR story

"The Justice Department is directing prosecutors to stop limiting defendants' ability to seek compassionate release in most federal plea agreements, after advocates criticized the practice as cruel and against the intent of Congress.

DOJ officials handed down the order a month after an NPR story detailed the practice, which curtailed peoples' ability to petition for release from prison because of severe illness or other extraordinary circumstances. That story drew the attention of Attorney General Merrick Garland who this week said it seemed "wrong" and pledged to fix the issue...

The compassionate release program has become a crucial lifeline for people in prison during the coronavirus pandemic, even if the petitions are still granted rarely."