Documentation can contain malicious instructions for agents
…In 40 runs, Anthropopic's Haiku model wrote the malicious package cited in the docs into the project's requirement.txt file every time, without any mention of that in its output…
Search
Related topics:
Anthropic
Tracked topic
Anthropic
Stay informed on Anthropic’s AI development, focusing on Claude AI updates, safety protocols, and the future of AGI threats.
VS Code goes weekly, gets AI autopilot - what could go wrong
…for use. Be extremely careful where and when you automatically allow agent actions," it says. Anthropic tries to hide Claude's AI actions. Devs hate it Read more The description of Auto…
QCon London: AI for developers is in a 'dangerous state'
…Yegge did this with a project called Gas Town , "an industrialized coding factory manned by superintelligent robot chimps." Cursor and Anthropic are also experimenting with agent swarms, Böckeler said, and Claude Code…
Meta's new model is as open as Zuckerberg's private school
…The model boasts performance matching and in many cases besting the top models from OpenAI, Anthropic, and Google. But before you read too far into these benchmark numbers, remember that they're…
Open source isn't a tip jar – it's time to charge for access
…So you'll excuse me if I'm not blown away by the fact that Anthropic, AWS, GitHub, Google, Microsoft, OpenAI, and others – total market cap in the ballpark of $7.7…
AI agents are 'gullible' and easy to turn into your minions
…want to do that, because it's been trained not to." Cursor, which heavily uses Anthropic's Claude models, has guardrails that prevent it from accessing and exfiltrating secrets. So instead of…
Calling out corporate BS? There's a steaming pile to aim for
…In an inventive, incisive study into the anthropology of business linguistics, researchers at that institution have proven the old adage, "bullshit baffles brains." Those most impressed by the use of corporate jargon…
AWS CEO: It's funny when people ask me if AI is overhyped
…of mass unemployment – has been stirring in the words of OpenAI's Sam Altman or Anthropic's Dario Amodei in their public pronouncements about the impact of AI. The way through, the…