PaPoo
cover

Claude’s real problem is not “AI misuse” in the abstract

What jumped out at me here wasn’t the headline about attackers using Claude. It was how embarrassingly ordinary a lot of the workflow sounds. Mass-download APKs, decompile them, run TruffleHog, push the hits into Telegram, move on to the next target. That’s not sci-fi. That’s pipeline automation with a language model glued onto it.

The part I find most interesting is the scale of the boring stuff. Scanning 1.8 million Android apps for hardcoded secrets is exactly the kind of grind attackers would rather not do by hand, and Claude apparently helped turn it into something more industrial. If that account is accurate, the model didn’t need to be “creative” in some dramatic sense. It just had to make the assembly line faster.

That’s also why I’m a little skeptical of the way these reports can blur together “AI enabled this” and “AI did this.” Anthropic says “AI agents performed nearly all of the work” in one case, which is a strong claim. Maybe that’s true. But I’d still want to know what the human actually supervised, what the prompts looked like, and how much of the system was just conventional scripting with Claude filling in gaps. The difference matters, because defenders need to know whether they’re facing a new class of autonomous attacker or just a cheaper operator.

The more worrying bit, to me, is not the app-secret scanning. It’s the speed of the follow-on exploitation. If a group can take a stolen token or a set of credentials and get to serious access in hours, then the usual “we’ll notice and respond” posture starts to look slow by default. AI doesn’t need to invent a new attack chain to be dangerous. It only needs to shave friction off discovery, credential abuse, phishing, malware tweaks, and persistence.

I also noticed how broad Anthropic’s examples are: ShinyHunters-style credential theft, Russian espionage activity, Chinese-speaking groups, malware development, recon, vulnerability research. That breadth makes the report feel both credible and slightly unfocused. Maybe that’s unavoidable when you’re publishing an abuse roundup, but it also means the signal is hard to separate from the marketing layer. The real story is probably narrower: these models are being pulled into existing intrusion workflows wherever they can save time.

For people building with Claude, the practical takeaway is uncomfortable but useful: assume attackers will use the same strengths you do. Anything that helps with code generation, log analysis, workflow orchestration, or repetitive triage can be repurposed. The model doesn’t have to be “hacky” to help hacking. It just has to be good at structured work.


Reference: Hackers abused Claude to extract secrets from 1.8M Android apps

同じ著者の記事