PaPoo
cover

Faster is not the same as better, and that’s the interesting part

What jumps out to me is how little the scorecard seems to care about the thing most marketing comparisons obsess over: raw correctness. If both systems hit the same accuracy, then the real question becomes whether you want the model that gets to the answer quickly or the one that keeps talking until it has sanded every edge off the reasoning. That’s a more honest test than the usual synthetic leaderboard theater.

I’m also a little suspicious of how neatly this maps onto brand personality. ChatGPT being faster and Claude being more thorough feels plausible, maybe even a bit too plausible. It risks becoming a self-fulfilling story where any short answer from ChatGPT is called efficient and any long answer from Claude is called careful. I’d want to know whether the benchmark was sensitive to verbosity in a way that penalized the more concise system, because “explained more” is not automatically “helped more.”

Still, for people actually using these tools at work, that distinction matters. There are times when you want a model to be a blur of competent autocomplete and times when you want it to stop and expose its reasoning, caveats, and assumptions. The annoying part is that the better choice changes by task, and a single “work mode” label doesn’t tell you enough. I think that’s the real takeaway here: these products are converging on the same baseline competence, so product design and interaction style are becoming the differentiator.

The Claude/Cowork setup is interesting precisely because it sounds like Anthropic is trying to make the chat/work boundary less annoying, not more mystical. If that merged experience really encourages people to stay in one place and keep context flowing, that could be more valuable than chasing a marginal speed win. But I’d still rather see comparisons on real workflows — debugging, review, doc generation, incident triage — than on a benchmark whose most memorable finding is basically “they were both right.”


Reference: Claude's merged chat and Cowork vs. ChatGPT's Work mode: ChatGPT is faster, Claude is more thorough

同じ著者の記事