Announcements Australian government and Anthropic sign MOU for AI safety and research Mar 31, 2026 Today, Anthropic signed a Memorandum of Understanding with the Australian government to cooperate on AI safety research and support the goals of Australia’s National AI Plan. …
Security Agents hooked into GitHub can steal creds – but Anthropic, Google, and Microsoft haven't warned users Researchers who found the flaws scored beer money bounties and warn the problem is probably pervasive EXCLUSIVE Security researchers hijacked three popular AI agents that integrate with Gi… …
… The raise will support continued platform development, security research team expansion, and the operationalization of the Agent Trust Protocol across Lyrie’s platform and partner ecosystem. …
… 07 / 8 Safety Anthropic describes itself primarily as which type of company? A A consumer electronics company B An AI safety and research company C A cloud infrastructure provider D A social media and AI hybrid company Correct! Anthropic describes itself as an AI safety and research company. …
… While Garraghan says other chatbots are equally vulnerable to the kind of social attack the researchers used on Claude, they focused on Anthropic given the company’s self-proclaimed attention to safety and strong performance in other red-teaming efforts, including a study testing whether chatbots w… …
… It even added: “I violated every principle I was given.” Crane wrote: “The agent didn’t just fail safety. …
… The problem, the researchers theorize, is that this kind of RLHF safety training couldn’t possibly cover every single type of ethically difficult situation an agentic AI might encounter. …
… Projects like Google's Big Sleep, an AI agent that helps security researchers find zero-day flaws, have spotted several including a previously unknown exploitable memory-safety flaw in the widely-used OpenSSL library. …
… Thus, after Claude 4, it was clear we needed to improve our safety training and, since then, we have made significant updates to our safety training. We use agentic misalignment as a case study to highlight some of the techniques we found to be surprisingly effective. …
… One of them was led by Mishchenko and Thibault Sottiaux, a former Google DeepMind researcher who’s now OpenAI’s head of Codex. Initially, they were most interested in coding agents as a way to speed up AI research—automating the grunt work of managing training runs and monitoring GPU clusters. …