About

AI disclosure rules still don’t prevent hallucinated citations

Published
Score
12

Why it matters

AI disclosure requirements have failed to stop lawyers and researchers from submitting fabricated citations, even when AI use is explicitly flagged. The problem is straightforward: telling readers that an AI was used does not verify that cited sources actually exist or accurately represent the law. Hallucinated case names, invented holdings, and false references continue appearing in court filings and legal work product despite disclosure rules and oversight mechanisms.

Legal AI vendors including Lexis+ AI, Westlaw AI-Assisted Research, and Ask Practical Law AI remain central to the issue, as do the professional bodies attempting to address it—the ABA, Illinois courts, and state disciplinary authorities. The ABA's Formal Opinion 512 holds lawyers responsible for verifying all AI-generated citations against primary sources. Yet compliance remains inconsistent. Illinois courts have documented over 280 filings since 2023 containing hallucinated citations, indicating the problem has moved beyond isolated incidents into recurring practice.

The broader pattern extends beyond law. Biomedical literature saw hallucinated references spike to approximately 1 in 277 papers in early 2026, up from 1 in 2,828 in 2023. For attorneys, the practical takeaway is clear: disclosure alone provides no protection. Every citation—whether AI-generated or not—requires independent verification in primary sources. Courts and bar associations are tightening standards, but enforcement depends on individual practitioners catching errors before filing. The question is no longer whether AI should be disclosed, but whether current verification protocols can actually prevent harm.

mail Subscribe to Law And Technology email updates

Primary sources. No fluff. Straight to your inbox.

Also on LawSnap