Counsel, do you watch the news? Do you listen to the radio? Do you read anything about what’s going on in the world? [...] Because the problem with lawyers relying on AI hallucinations is an ‘above-the-fold’ story every single day.
Image from The Guardian
Every fabricated-citation case on this page invented a judgment. This one invented witnesses, in a murder appeal. Stephen Aarons, a Santa Fe defence lawyer, fed a machine-generated trial transcript to ChatGPT expecting a summary and filed what came back: testimony from four people who never gave it, two of them presented as police officers, down to what the shooter was wearing. He did not tell his client, who is serving a life sentence. At the hearing on 21 August Justice Bacon asked him the question quoted here. The order of 9 September holds him in contempt, fines him 5,000 US dollars payable to the state bar's client protection fund within 30 days, strikes every brief he filed, hands the appeal to the public defender to start over, bars him from the court while a disciplinary referral runs, and finds a lack of concern for his client. Aarons calls it an honest mistake.
Justice C. Shannon Bacon, Supreme Court of New Mexico, in The Guardian