About
AI Hallucination Incident

AI Hallucination Incident

Tracking Ai Hallucination Incident legal and regulatory developments.

2 entries in Legal Intelligence Tracker

AI disclosure rules still don’t prevent hallucinated citations

AI disclosure requirements have failed to stop lawyers and researchers from submitting fabricated citations, even when AI use is explicitly flagged. The problem is straightforward: telling readers that an AI was used does not verify that cited sources actually exist or accurately represent the law. Hallucinated case names, invented holdings, and false references continue appearing in court filings and legal work product despite disclosure rules and oversight mechanisms.

Florida judge strikes ex-Chartwell lawyer’s sanctions motion over AI citation errors

A Florida federal judge has struck a sanctions motion filed by Christopher Sharp, counsel for former Chartwell Law Offices LLP attorney Zohra Khorashi, and indicated she may impose monetary sanctions against Sharp himself for relying on hallucinated AI-generated case citations. The ruling rejected Sharp's attempt to sanction Chartwell in an underlying employment-discrimination case.

LawSnap Briefing Updated May 11, 2026

State of play.

  • Sanctions for AI hallucinations have escalated from monetary fines to contempt proceedings. The New Jersey federal court has issued a show-cause order against attorney Tyrone Blackburn for failing to pay $6,000 in sanctions tied to a fabricated case citation in the Combs litigation — marking the shift from sanction imposition to contempt enforcement .
  • Case-dispositive consequences are now established at multiple court levels. The Alabama Supreme Court dismissed an appeal outright over AI-hallucinated briefs, and a Quebec court annulled an entire arbitral award after finding the arbitrator built the decision on fabricated citations — moving consequences beyond the attorney and onto the proceeding itself .
  • Government lawyers are not insulated. Two New Orleans government attorneys resigned over fake AI citations, and the 7th Circuit admonished a former immigration judge for fake cases in a brief .
  • Supervising attorneys carry personal liability for staff AI use. ABA Formal Opinion 512 and state bar rules — including California's mandatory human-review requirements — place the verification obligation on the supervising lawyer, not the associate or staff member who ran the query .
  • For counsel advising firms on AI governance, the practical baseline is that unpaid sanctions now trigger contempt, citation verification is a non-delegable professional obligation, and the consequences span contempt proceedings, case dismissal, arbitral annulment, six-figure sanctions, and suspension — not just fines.

Where things stand.

  • Judicial consensus on attorney accountability is settled. Courts across jurisdictions — federal and state, trial and appellate — have uniformly held that reliance on unverified AI output constitutes a breach of professional responsibility, regardless of who in the firm ran the query .
  • AI hallucinations have appeared in at least 157 lawsuits worldwide. The scope is not isolated; it is a systemic pattern across practice areas and court levels .
  • ABA Formal Opinion 512 (July 2024) is the governing ethics framework. It establishes standards for AI use in law firms; California and other jurisdictions have layered on mandatory human-review and documentation requirements under Model Rule 5.3 .
  • Sanction severity is escalating. Oregon federal courts have exceeded $100,000 in Green Building Initiative v. Peacock (2025); the Oregon appellate per-error formula — roughly $500–$1,000 per hallucination, derived from Ringo v. Colquhoun Design Studio, LLC (2025) — is now being cited in federal rulings .
  • Case-dispositive consequences are established. The Alabama Supreme Court dismissed the appeal entirely; the Quebec court annulled the arbitral award; Flycatcher Corporation v. Affable Avenue produced a default judgment — consequences that go beyond sanctioning the attorney and void the underlying proceeding .
  • The Quebec ruling extends liability to decision-makers, not just advocates. Prior rulings sanctioned lawyers and litigants for filing hallucinated content; Justice Sheehan's annulment in ARIHQ v. Santé Québec targets the arbitrator — a doctrinal shift with direct implications for arbitration clauses and institutional rules that are silent on AI use .
  • Explicit no-AI policies do not insulate firms. The Oregon case turned on staff use of AI despite a firm prohibition — the supervising attorney was sanctioned anyway .
  • Government and prosecutorial practice is exposed. Resignations at the DOJ level and the 7th Circuit's admonishment of a former immigration judge demonstrate that the problem is not confined to private civil litigation .
  • Enforcement is now moving to the collection stage. Courts are treating noncompliance with sanctions orders as grounds for contempt rather than as a cost of doing business — a qualitative shift in judicial posture .

Latest developments.

  • Tyrone Blackburn, counsel for a Combs accuser, faces a contempt show-cause hearing in New Jersey federal court after missing payments on a $6,000 sanctions order tied to a fabricated AI case citation — the first prominent instance of courts moving from sanction imposition to contempt enforcement for AI-related misconduct .

Active questions and open splits.

  • How far does supervising-attorney liability extend? Courts and bar authorities are applying Model Rule 5.3, but the outer boundary — how much oversight of AI-using staff is sufficient, and what documentation satisfies the duty — remains undefined across jurisdictions .
  • Does an explicit no-AI policy insulate the firm? The Oregon case says no — staff violations bind the supervising attorney regardless. Whether other circuits and state bars will adopt the same position is unsettled .
  • What AI use by arbitrators and judges is permissible? The Quebec court drew a line between peripheral AI use and reliance on AI-generated legal foundations, but the line is not yet defined with precision — creating uncertainty for arbitration clauses and institutional rules that are silent on the question .
  • Will contempt become the standard escalation path for unpaid AI sanctions? The Blackburn show-cause order signals that courts will not treat missed sanction payments as a cost of doing business, but whether contempt proceedings become routine — and what coercive measures follow — is unresolved .
  • Will case-dispositive sanctions become the standard deterrent? Alabama dismissed the appeal; Quebec annulled the award; Flycatcher produced a default judgment. Whether trial courts and other appellate courts will follow with dismissals and defaults — rather than fines — as the primary sanction is an open question with significant implications for clients whose cases are at risk .
  • Is the per-error formula the emerging national benchmark? Oregon's $500–$1,000 per hallucination formula is being cited in federal rulings, but no circuit has formally adopted it, and sanction amounts remain highly variable .
  • What disclosure obligations attach to AI use in filings? Some courts have standing orders requiring AI disclosure; others do not. Whether a uniform federal rule or circuit-wide standing order emerges — and what it requires — is unresolved .

What to watch.

  • Whether the Blackburn contempt hearing produces a finding — and what coercive measures Judge Hillman imposes — which would establish the first clear template for contempt enforcement of AI sanctions orders .
  • Whether arbitral institutions (AAA, JAMS, ICC) update their rules to address arbitrator AI use in the wake of the Quebec annulment — the most immediate institutional response the ARIHQ ruling demands .
  • Whether any federal circuit adopts a formal standing order on AI disclosure and verification, which would set a national floor for civil practice .
  • Whether bar disciplinary authorities in California, New York, or Texas issue formal guidance on supervising-attorney obligations under Rule 5.3 that goes beyond ABA Opinion 512 .
  • Whether DOJ or federal agency legal offices issue internal AI-use protocols following the government-attorney resignations .

mail Subscribe to AI Hallucination Incident email updates

Primary sources. No fluff. Straight to your inbox.

Also on LawSnap