Current guardrails are a mix of industry best practices, voluntary screening and government regulation. Many synthesis companies willingly participate in sequence screening initiatives that flag orders matching known pathogens or dangerous sequences. Some generative AI companies also apply content and model-safety policies that block prompts about biological-harm instructions. But in the open letter, experts across the fields of science, technology, public policy, academia and law are proposing tougher measures. The public letter shows a consensus that the risks of AI-developed bioweapons des
AI Leaders Call for Rules on Synthetic DNA to Limit Bioweapons RiskIf an AI system is too cautious, it might refuse legitimate nuclear engineering coursework. Too permissive, and it could inadvertently assist bad actors. Our classifier appears to strike the right balance. In preliminary testing with synthetic data, we achieved a 94.8% detection rate for nuclear weapons queries and zero false positives (overall, 96.2% of the classifier’s labels in this test were accurate as shown in Figure 2), suggesting this system would not flag legitimate educational, medical, or research discussions as concerning. This precision matters because nuclear conversations in AI
Developing Nuclear Safeguards for AI…AI adviser, and Ben Buchanan, a former Biden White House AI adviser, co-authored a New York Times op-ed calling on Congress to mandate third-party audits of AI developers' safety…
…Article continues below The new approach sounds a lot like the UK's AI Security Institute model, where government bodies evaluate frontier models against safety benchmarks before and after deployment. Officials told…
…key areas where it would throttle Fable’s responses for safety: chemistry, biology, cybersecurity, and distillation, a technique for training smaller AIs using the outputs of larger ones. The company has accused…
…Anthropic is separately suing the Pentagon following an impasse over the use of its models in autonomous weapons, and has opposed federal efforts to preempt state AI regulation . Follow Tom's Hardware…
…soon be used to break the AI agents coexisting with us in the real world — booking meetings, managing calendars, ordering food, handling customer service — and safety teams will need to ensure models…
…AI should not be used for domestic mass surveillance or autonomous weaponry without appropriate human oversight. Notably, the agreement requires that Google will “assist in adjusting its AI safety settings and filters…
…Many top AI companies are fighting lawsuits about everything from data centers to AI safety , most prominently in the courtroom drama featuring OpenAI's Sam Altman and xAI's Elon Musk. Meanwhile…
…Ultimately, decisions about surveillance authorities, autonomous weapons , and rules of engagement belong in democratic institutions. This episode illustrates a pivotal moment in AI governance. AI systems at the frontier of technology are…
…AI safety and jailbreaks This isn't the AI developer's first conflict with Washington over AI models. The Department of Defense declared Anthropic a "supply chain risk" earlier this year after…
…This will allow players to sneak around more easily and execute stealth kills from the safety of the shadows. The stealth gameplay also includes a full array of stealth weapons, including a…
