Data Science Wire

How I tricked Claude into leaking your deepest, darkest secrets

Simon Willison2w4 min read

How I tricked Claude into leaking your deepest, darkest secrets I've been impressed by the way the Claude web_fetch tool is designed to avoid data exfiltration attacks. Ayush Paul found a hole in that design. To recap: regular Claude chat is at risk of lethal trifecta attacks, because it has access to private data (in the form of memories of your past interactions) and has a tool for accessing online content which can both read hostile instructions and exfiltrate data through the URLs it accesses. Anthropic's protection is that web_fetch can only be used to navigate to exact URLs that the user

Read the full story at Simon Willison

More in Governance / Quality