About

Prosecutors warn AI misuse and fake evidence are creating new courtroom risks

Published
Score
9

Why it matters

Prosecutors across the country are using AI tools to manage heavy caseloads and staff shortages, but the technology is already producing serious errors in criminal cases. Recent incidents include a prosecutor who resigned after filing an AI-drafted brief without adequate review, and a Georgia prosecutor suspended by the state Supreme Court for submitting AI-generated fake citations in a murder case ruling. The National Center for State Courts has flagged concerns that AI-generated evidence can erode public trust in the justice system. District attorneys' offices, judges, defense counsel, and legal technology providers including Lexis and Westlaw are all grappling with how to deploy these tools responsibly.

The scope of AI misuse in prosecutorial work remains unclear. Courts have documented fabricated quotations, false case citations, and misleading filings, but no comprehensive data exists on how widespread these errors are or which offices have been affected. The extent to which smaller or under-resourced offices are more vulnerable to these failures has not been systematically studied.

Prosecutors face genuine pressure to adopt AI for legitimate purposes—reviewing records, transcribing audio and video, summarizing evidence, and identifying patterns—particularly in offices with limited staff. But without verified workflows, adequate training, and detection tools, the same capabilities that accelerate case review can hallucinate facts or introduce errors that damage prosecutions and trigger professional discipline. Attorneys should monitor whether their jurisdictions are developing AI governance standards and whether courts begin imposing sanctions for AI-assisted filings that lack proper human review.

mail Subscribe to Law And Technology email updates

Primary sources. No fluff. Straight to your inbox.

Also on LawSnap