PaPoo
cover

A speaker-labeling app is a good use of Claude Code, but the article oversells the easy parts

What jumped out at me is not that someone built this with Claude Code. That part is pretty believable. What jumped out is how casually the article treats “speaker recognition” as if it were basically a tidy embeddings problem once you have a transcription tool. I don’t think that’s fully wrong, but it feels like the hard parts have been smoothed over a bit too much.

The most convincing part of the piece is the product instinct. If you actually sit on meeting audio and keep needing to search back through it, anonymous speaker labels get old fast. A small internal tool that maps recurring voices to names is exactly the kind of thing a coding agent is useful for: narrow scope, obvious workflow, low need for polish. That’s the sweet spot. I’d absolutely believe this can save a few hours or days if you already know what “done” looks like.

Where I’m less convinced is the confidence around the matching step. The article talks about audio embeddings and cosine similarity as if a single threshold cleanly separates “known person” from “new person.” Maybe it works in this setup. But voice similarity is messy: microphone changes, background noise, speaking style, call quality, even sickness can move the embedding around. An 80% cutoff sounds pleasantly concrete, but I’d want to know how often it false-matches across meetings, and whether the system ever confuses two people who sound even vaguely alike. That’s the real test, not whether it feels right on a few hand-picked examples.

I also think the article quietly depends on Soniox doing a lot of heavy lifting. If the diarization and timestamps are reliable, the rest becomes much easier. If they’re not, the whole pipeline gets shakier fast. The writeup says it “fully trusts” the transcription output in most cases, which is exactly the kind of sentence that makes me nervous. Internal tools can get away with a lot, but once a bad speaker split propagates into the matching logic, you can end up confidently attaching the wrong name to the wrong words. That’s worse than an anonymous transcript.

The Claude Code angle is still the interesting bit to me. Not because the model magically designed the system, but because the author used it the way people actually use coding agents when they’re productive: one long, specific prompt, then some correction after the fact. That’s much more realistic than the fantasy version where you hand over a vague idea and get a finished app. The article accidentally shows the opposite: the best results came from already having a pretty clear mental model of the app. Claude Code helped implement it. It didn’t invent the product sense.

If anything, this reads like a good advertisement for building narrow tools with LLM coding help, and a weak advertisement for believing the model will save you from thinking. The tool sounds useful. The workflow sounds sane. The confidence about robustness? Less so.

同じ著者の記事