From Hacks to Bioweapons, Claude Misuse Is Now Everywhere
From Hacks to Bioweapons, Claude Misuse Is Now Everywhere 🚨
Anthropic has been perhaps more vocal than any other AI company about the ways in which its tools are prone to misuse. It published some of the first reports of its AI service Claude being used in cybercriminal hacking operations and the discovery that its AI agents had, like those of its competitor OpenAI, escaped their sandbox and autonomously breached the networks of several organizations as part of their attempts to fulfill their users’ commands.
This week, the company released a new overarching report on how Claude has been abused over the last eight months, and the results are staggering in their breadth. In case study after case study, the company documents how Claude was exploited for state-sponsored and cybercriminal hacking, disinformation campaigns, and influence operations, and even attempted development of bioweapons. In all of these cases, Anthropic says that it disrupted the activity in progress.
Key Findings 📊
- In one case, a group of Russian state-sponsored hackers identified by Microsoft as Midnight Blizzard used Claude for reconnaissance, breaching targets that included Ukrainian and other European government networks, stealing data and maintaining access.
- Cybercriminal group ShinyHunters used Claude in practically every stage of its hacking and extortion campaigns.
- Disinformation campaigns focusing on politics everywhere from Kenya to Bangladesh utilized the tool.
- Perhaps most disturbingly, in a handful of cases, Anthropic discovered what appeared to be users of its tools attempting to develop potential bioweapons like disease pathogens and toxins.
Facebook’s Troubling Content 🌐
Separately, Facebook is hosting a large network of accounts uploading AI-generated videos that depict violence against children, according to Futurism, which spent days cataloging the material and kept finding more than it could count. The clips show young children being beaten, burned, confined, and starved. Futurism said it found most of the accounts by opening one and then following Facebook’s recommendation feed, which supplied a continuous stream of similar videos—a sign Meta’s own systems can already identify the category of content the company says it bans. Futurism reported eight of the accounts through the standard user channel. Meta removed two, one of them after first rejecting the report. The company deleted most of the videos sent to its press office but initially left others up, including one showing a child locked in a freezer.
Xinbi Guarantee and Ransomware Gangs 💻
In other cybercrime news, Xinbi Guarantee, over its four-year lifespan, grew into the biggest illicit marketplace on the internet. This week, the US government stepped in, seizing Xinbi’s channels on Telegram’s platform and sanctioning the market. The Justice Department simultaneously announced raids on 13 scam compounds in Madagascar.
Meanwhile, the ransomware gang Conti was, until it officially disbanded in 2022, one of the most dangerous hacker crews in the world. According to US law enforcement, it hit more than a thousand victims, extorting millions and at one point disrupting government systems in Costa Rica so completely that it triggered a state of emergency. Now one member of that group is facing justice: 44-year-old Ukrainian Oleksii Oleksiyovych Lytvynenko was sentenced to four years in prison this week, in a rare example of a ransomware actor who will see the inside of a US prison.