23 July 2025

At Least One Court Has Accepted AI Hallucinations in Ruling

The insanity off all this is that uncovering the existence of Artificial Intelligence fabrications is not complicated. It’s “frighteningly likely” many US courts will overlook AI errors, expert says

Fueling nightmares that AI may soon decide legal battles, a Georgia court of appeals judge, Jeff Watkins, explained why a three-judge panel vacated an order last month that appears to be the first known ruling in which a judge sided with someone seemingly relying on fake AI-generated case citations to win a legal fight.

A couple of states are trying to get Judges to understand the problem. I never worked with judges, but I have worked with corporate lawyers. You can't tell lawyers anything, because lawyers are better than everyone. They have to been shown complete, devastating consequences of their actions (around ignoring security) before they will even consider changing procedures.

I miss living in a civilized society, ruled by law, and not whim.

2 comments:

  1. I recall from the first months of this year that, upon discovering prosecution had used AI, the judge dismissed the case. The judge then threatened to sanction the lead attorney.
    I heard no more, I reckon there was no sanction, only a reprimand.

    Unless the courts act swiftly, the courts will be clogged with appeals. Because of experience, I'm jaded. Because I'm jaded, I reckon the BAR Assoc. is trying to figure how to use this to their advantage. Meaning they don't see this as a bad thing

    ReplyDelete
    Replies
    1. There were two cases like this if I remember correctly, and in one case it was a law-school graduate who was still studying for the bar exam that got fired.

      As for the lawyers, they may see chaos as billable hours, but then there is a lot of "loser pays for legal fees" going on around the country. So if you get a rep as someone who always loses because of AI and costs you clients a boatload of money ...

      Delete

Comment Moderation is in place. Your comment will be visible as soon as I can get to it. Unless it is SPAM, and then it will never see the light of day.

Be Nice. Personal Attacks WILL be deleted. And I reserve the right to delete stuff that annoys me.