Judicial System Shaken: AI’s Fake Citations Threat

A wooden gavel resting on a desk with a laptop in the background

A Georgia prosecutor’s use of artificial intelligence to draft legal briefs loaded with fabricated case citations has triggered a statewide warning about technology threatening the integrity of the judicial system—exposing how easily AI-generated falsehoods can infiltrate courts and compromise defendants’ rights.

Quick Take

  • Georgia Supreme Court suspended ADA Deborah Leslie for six months after she used AI to generate briefs containing at least nine false or misrepresented case citations in a high-profile murder appeal.
  • The court issued a statewide warning to all Georgia attorneys and trial judges about AI risks, stating the conduct “falls far beneath the conduct we expect from Georgia lawyers.”
  • The case has been sent back to trial court for a complete redo, raising serious questions about how many other cases may have been compromised by AI-generated legal errors.
  • This disciplinary action signals that no explicit rule against AI use exists, but there is absolutely no excuse for submitting fraudulent legal work to the courts.

How AI-Generated Fake Citations Infiltrated Georgia Courts

Assistant District Attorney Deborah Leslie of Clayton County submitted legal briefs to the Georgia Supreme Court in the Hannah Payne murder appeal that contained multiple fabricated case citations. The court identified at least five cases that don’t exist and at least five additional citations that don’t support the propositions they were meant to defend. Leslie later admitted in an affidavit that she used artificial intelligence to conduct what she called “expanded legal research,” but failed to independently verify the citations the AI generated.

The Public Confrontation That Exposed the Problem

During oral arguments before the Georgia Supreme Court, Chief Justice Nels Peterson publicly identified what he called “phantom cases”—legal citations that either didn’t exist or bore no relationship to the arguments they supposedly supported. This public confrontation during proceedings forced immediate acknowledgment of the problem. The court then directed the state to explain the deficient filings, triggering a chain of events that led to Leslie’s admission of AI use and District Attorney Tasha Mosley’s formal apology letter to the Chief Justice.

Sanctions and the Statewide Warning

The Georgia Supreme Court imposed a six-month suspension on Leslie from practicing before the state’s high court and mandated that she complete twelve hours of continuing legal education on proper AI use before reinstatement. Justice Benjamin Land’s majority opinion included a direct warning to all Georgia lawyers: “We strongly encourage trial courts to carefully review proposed orders with the understanding that artificial intelligence software, with all of its potential risks and benefits, may have been used to prepare such proposed orders.” The court acknowledged that no rule explicitly prohibits AI use in legal drafting, but emphasized there is no excuse whatsoever for submitting work containing false case law.

A Defendant’s Appeal Sent Back to Square One

Hannah Payne, serving a life sentence in a murder case, had her appeal process compromised by Leslie’s fraudulent filings. The Georgia Supreme Court vacated the trial judge’s original order denying her motion for a new trial and ordered the judge to redo the ruling without any attorney input from either side. This unusual step reflects the court’s determination to ensure a clean process untainted by the AI-generated errors. Payne now has an opportunity for fair appellate review, though the delay raises troubling questions about how many other cases may have been affected by similar AI misconduct.

Institutional Failure and Prosecutorial Accountability

Clayton County District Attorney Tasha Mosley formally apologized to the Georgia Supreme Court, stating: “In my almost 30-year career as an attorney and 17 years as an elected official, I never imagined a situation where I would do what I am doing now.” Mosley acknowledged that Leslie violated the office’s ethical standards. While the court admonished the entire Clayton County District Attorney’s office for institutional responsibility, Mosley herself was not individually sanctioned—a decision that drew dissent from two justices who believed the elected DA bore personal accountability for office oversight.

Why This Matters Beyond Georgia

This case represents a watershed moment exposing a critical vulnerability in America’s judicial system. AI language models can confidently generate false information that appears authentic—a phenomenon researchers call “hallucination.” Legal professionals nationwide increasingly rely on these tools for efficiency, but many fail to implement adequate verification protocols. The Georgia Supreme Court’s disciplinary action signals that AI use doesn’t excuse professional responsibility. Attorneys remain the gatekeepers of accuracy, and courts expect rigorous verification of all citations regardless of how they were generated. This precedent will likely influence other state bar associations to develop comprehensive AI governance rules.

Sources:

Clayton prosecutor suspended over phony AI citations – AJC.com

Clayton prosecutor punished for using AI in court filings, citing fake cases – Fox 5 Atlanta

AI in Georgia courts raises new questions after Clayton County prosecutor admits citing fake cases – CBS News Atlanta