The awkward honesty of Anthropic paying its own evaluator
What surprised me here is not that Anthropic is paying for evaluation. It’s that it says, in effect, “yes, this is a bad setup, but we’re doing it anyway because the better setup doesn’t exist yet.” That’s unusually blunt for a company announcement, and honestly more interesting than the partnership itself. The obvious problem is the one the article keeps poking at: if the evaluator’s bill is paid by the lab being evaluated, independence is always going to look slightly performative, no matter h
papoo.work