UK lawyers urged to desist misuse of AI after fake case citations
In one notable case, the claimants in a £89m damages lawsuit against the Qatar National Bank presented 45 case-law citations, of which 18 were proven to be fictitious.
The High Court has issued a stern warning to senior lawyers, urging them to take immediate action to prevent the misuse of artificial intelligence (AI) tools in legal practice, after multiple cases were marred by fake case-law citations. These citations, either entirely fictitious or containing fabricated passages, were believed to have been generated by AI systems, raising serious concerns over their potential impact on the justice system.
In one notable case, the claimants in a £89m damages lawsuit against the Qatar National Bank presented 45 case-law citations, of which 18 were proven to be fictitious. Many of the other citations contained fabricated quotes. The claimant admitted to using publicly available AI tools, and their solicitor acknowledged the use of the sham authorities.
Similarly, in a case brought by Haringey Law Centre against the London Borough of Haringey, the lawyer cited five instances of phantom case law. These citations raised suspicion when the defending solicitor could not find any trace of the referenced authorities. This led to a legal action for wasted costs, with the court ruling that the law centre and its lawyer, a pupil barrister, were negligent. The barrister denied knowingly using AI but speculated that AI summaries may have inadvertently influenced her work during research for another case.
In response to these incidents, Dame Victoria Sharp, the president of the King’s Bench Division, highlighted the “serious implications” of AI misuse for public trust in the justice system. She warned that lawyers who misuse AI could face a range of sanctions, including public admonishment, contempt of court proceedings, and possible referral to the police. Dame Sharp also called on the Bar Council and the Law Society to urgently address the issue and ensure that all lawyers understand their ethical responsibilities when using AI tools.
AI tools, while capable of generating seemingly plausible legal responses, have been found to produce incorrect and misleading outputs. Dame Sharp emphasized that AI-generated content may assert untrue facts, cite non-existent sources, or quote passages that do not appear in the original text.
The warning comes amid increasing reliance on AI in legal work, but it underscores the need for rigorous checking and verification. Ian Jeffery, the Chief Executive of the Law Society of England and Wales, echoed the concern, noting that the rise of generative AI tools necessitates greater caution and responsibility among legal professionals.
These cases are part of a growing trend where AI-generated "hallucinations" have disrupted legal proceedings. In 2023, a UK tax tribunal case involved an appellant who relied on nine bogus historical tribunal decisions, allegedly created by AI. Similar instances of AI-generated citations have also been reported in Danish and US courts, resulting in fines and legal chaos.
The High Court’s ruling serves as a critical reminder to the legal community about the potential risks of using AI without proper oversight, calling for heightened scrutiny to maintain the integrity of the justice system.
