大模型
theguardian.com ·
@Reuters
新墨西哥州律师因提交含 AI 编造警方证词的法律文书被罚款
新墨西哥州最高法院周三对辩护律师 Stephen Aarons 处以罚款并裁定其藐视法庭,原因是他在为客户谋杀定罪上诉提交的法律文书中包含由 OpenAI 的 ChatGPT 编造的警方证词和证人。Aarons 称其借助该 AI 应用准备了这份文书,法院认定他未核实文件准确性。
AI推荐理由 新墨西哥州最高法院对律师 Stephen Aarons 处以罚款并判藐视法庭,因其提交的谋杀案上诉法律文书包含 ChatGPT 编造的警方证词和证人。这是 AI 幻觉在司法场景造成实际后果的可验证案例,来源为 Guardian,事实明确;但属个案报道,对 AI 技术本身的增量信息有限。
72
正文
The New Mexico supreme court building in Santa Fe on 9 January 2023. Photograph: Morgan Lee/AP
View image in fullscreen
The New Mexico supreme court building in Santa Fe on 9 January 2023. Photograph: Morgan Lee/AP
New Mexico lawyer fined for using AI-generated brief containing fabricated police testimony
Stephen Aarons said he tried to use ChatGPT to create a ‘bulletproof summary’ during a murder conviction appeal
A defense lawyer appealing his client’s murder conviction submitted a legal brief containing made-up police testimony and witnesses fabricated by OpenAI’s ChatGPT, New Mexico’s highest court said.
The New Mexico supreme court on Wednesday fined the attorney, Stephen Aarons, and held him in contempt for failing to verify the accuracy of the court filing, which Aarons said he prepared with help from the artificial intelligence (AI) application.
The filing “contained false testimony from wholly fabricated witnesses”, the court said.
Massachusetts teen accused of killing mother and brother used ChatGPT
Read more
The panel also said Aarons had “demonstrated a lack of remorse and a lack of concern for his client”. The justices fined Aarons $5,000 and said they will refer him to an attorney disciplinary board for investigation.
Aarons in a statement said he had used ChatGPT to summarize the trial proceedings when he agreed to take up the defendant’s appeal last year, and did not understand the degree to which AI could “hallucinate” facts.
“I am remorseful but hopeful that the disciplinary board takes into account it was an honest mistake,” he said. “It is a lesson learned for all professionals who rely upon this powerful but sometimes unstable technology.”
OpenAI did not immediately respond to a request for comment.
The court’s sanction is the latest in a growing number of cases in which state and federal judges have disciplined lawyers for submitting court documents generated by AI tools without adequately vetting them. Some judges have also faced scrutiny over the use of AI themselves.
Dozens of lawyers have been sanctioned for filing briefs in which AI made up case citations or misquoted the law. Aarons’ filing appears to have gone further, containing fabricated witness testimony in a criminal appeal.
Aarons, a private attorney based in Santa Fe, was handling the appeal of Oscar Renee Sandoval, who pleaded not guilty to the murder of the mother of his children before he was convicted and sentenced last year to life in prison.
The appeal is still pending and was assigned on 2 September to Kim Chavez Cook, a New Mexico public defender. Cook declined to comment. The local district attorney’s office also declined to comment.
The state supreme court last month ordered Aarons to explain how the fabricated material, which it said appeared to include “fictional statements that the shooter was wearing dark pants and a white shirt”, was included in his primary brief in the appeal.
Aarons told the court at an 21 August hearing that he fed a computer-generated transcript and other case materials to ChatGPT, presuming it would generate “a bulletproof summary”.
The justices sounded incredulous that Aarons was not fully aware of how AI can make mistakes.
“Counsel, do you watch the news? Do you listen to the radio? Do you read anything about what’s going on in the world?” Justice Shannon Bacon said at the hearing. “Because the problem with lawyers relying on AI hallucinations is an ‘above-the-fold’ story every single day.”
Explore more on these topics
ChatGPT
AI (artificial intelligence)
OpenAI
US crime
US justice system
news
Share
Reuse this content