US Court Ruling Sparks Legal Warnings: AI Chat Conversations Could Be Used as Evidence
A recent U.S. court ruling has prompted lawyers to caution clients against treating AI chatbots as confidential advisors, warning that conversations with tools like ChatGPT and Claude could be used in legal proceedings.
The concern follows a decision by Jed Rakoff, who ruled that a former executive facing fraud charges must hand over documents generated through interactions with an AI chatbot. The court determined that attorney-client privilege does not apply to AI platforms, as no legal relationship exists between a user and a chatbot.
The case involved Bradley Heppner, who had used Anthropic’s Claude to prepare materials related to his defense. Prosecutors successfully argued that because the communications were not directly with legal counsel, they were not protected and could be accessed as evidence.
Legal experts say the ruling highlights a critical gap in how traditional confidentiality protections apply in the age of AI. While communications between clients and their lawyers are generally protected under attorney-client privilege, sharing those details with third parties—including AI systems—can waive that protection.
Law firms across the U.S., including Kobre & Kim and Sher Tremonte, are now issuing advisories urging caution. Some have gone further, incorporating clauses into client agreements warning that disclosing legal information to AI platforms could compromise confidentiality.
“Clients should proceed with caution,” said Alexandria Gutiérrez Swette, reflecting a growing consensus among legal professionals.
The issue remains unsettled across jurisdictions. In a contrasting case, Anthony Patti ruled that a litigant’s ChatGPT conversations could be treated as personal work product rather than discoverable communications, underscoring the evolving and inconsistent legal interpretations around AI usage.
Compounding the issue, both OpenAI and Anthropic state in their policies that user data may be shared under certain conditions, and that their tools should not replace professional legal advice.
As AI adoption accelerates, attorneys are advising clients to avoid discussing sensitive legal matters with chatbots unless explicitly guided by legal counsel. Until clearer legal standards emerge, the prevailing guidance remains straightforward: treat AI tools as non-confidential—and assume anything shared could potentially be used in court.
