… Testers have found Opus 4.8 to be "more reliable and sharper in its judgement" when doing agentic tasks, and the model also made gains in honesty. Early testers report that Opus 4.8 is more likely to flag uncertainties about its work and less likely to make unsupported claims. …
Anthropic is releasing Claude Opus 4.8 on Thursday, and the company is touting the model’s “honesty.” According to Anthropic, it trains “all its models to be honest — for instance, to avoid making claims that they can’t support.” But it notes that “a general problem with AI models is that they some… …
… As Anthropic puts it: One of the most prominent improvements in Opus 4.8 is its honesty . We train all our models to be honest—for instance, to avoid making claims that they can’t support. …
… Anthropic claimed in the announcement that Opus 4.7 is measurably more honest than its predecessor, and scored a 91.7% on the MASK honesty benchmark, whereas Opus 4.6 scored 90.3%. This makes it very clear that honesty on a benchmark and honesty in practice are two very different things. …
… Opus 4.8 is a ‘more effective collaborator,’ Anthropic says Anthropic describes Claude Opus 4.8 as having “sharper judgement, more honesty about its progress, and the ability to work independently for longer than its predecessors.” “Early testers report that Opus 4.8 is more likely to flag uncertai… …
… Claude Opus 4.8 is being positioned as Anthropic's most capable model yet, with a particular emphasis on nuanced judgment, intellectual honesty and complex reasoning. …
… 01 / 11 One of the most prominent improvements in Opus 4.8 is its honesty . We train all our models to be honest—for instance, to avoid making claims that they can’t support. …
… Support claims appeals . Denied claims cost time and money for all parties. …
… These would test systems' reasoning, ability to deal with ambiguity, precision in following instructions, and a trap designed to force them into either honesty or hallucinations. …
… OpenAI claims otherwise, as you might imagine. …