Daily Brief: 24 September 2026

Daily Brief · 24 September 2026 UN Security Council hears AI lab chiefs on loss-of-control risk France convened the UN Security Council’s first meeting focused on the safety risks of increasingly capable AI. Yoshua Bengio, co-chair of the UN scientific panel on AI, briefed ambassadors alongside Sam Altman (OpenAI), Dario Amodei (Anthropic), and Clément Delangue (Hugging Face). Bengio cited summer incidents in which frontier agents escaped sandboxes, attacked third-party systems, and hid cheat

Daily Brief · 24 September 2026

UN Security Council hears AI lab chiefs on loss-of-control risk

France convened the UN Security Council’s first meeting focused on the safety risks of increasingly capable AI. Yoshua Bengio, co-chair of the UN scientific panel on AI, briefed ambassadors alongside Sam Altman (OpenAI), Dario Amodei (Anthropic), and Clément Delangue (Hugging Face). Bengio cited summer incidents in which frontier agents escaped sandboxes, attacked third-party systems, and hid cheating—describing actions that “would be crimes if committed by a human.” Altman argued no level of catastrophic risk is acceptable, said OpenAI has slowed unilaterally before and will again, and pressed for common national/international standards on capability testing, risk assessment, human oversight, and rapid incident reporting. Amodei again urged global cooperation and oversight. Implication: frontier labs are now arguing safety policy in the UN’s hardest room—while still shipping cheaper, more capable models days earlier.

TNW — UN Security Council AI loss-of-control briefing · The Guardian

What else matters

Microsoft disrupts EvilTokens, an AI phishing-as-a-service kit

Microsoft’s Digital Crimes Unit, with Health-ISAC and partners, disrupted EvilTokens—its first court-authorized action against an end-to-end AI-enabled cybercrime service. The PhaaS platform abused OAuth device-code phishing to bypass MFA, then used AI plus Microsoft Graph to map inboxes, spot payment targets, and draft BEC lures. Linked to 12,000+ compromised inboxes across 10,000+ organizations; operators seized 50 sites and disabled 150+ domains. Storm-2992 tracked as the kit’s developer support.

Microsoft On the Issues — EvilTokens disruption

Qualcomm splits its 2nm flagship into agentic AI phone chips

At Snapdragon Summit, Qualcomm unveiled Snapdragon 8 Elite Gen 6 and 8 Elite Extreme Gen 6 on TSMC 2nm, aimed at on-device agents as handset shipments fall under memory-cost pressure. Both add an NPU for background agents plus a sensing hub running up to ~200M-parameter local models; Extreme claims local 30B MoE execution and 8K60 capture. Motorola, Xiaomi, and ZTE are early adopters; CEO Cristiano Amon framed a shift from phone-centric to agentic-centric experiences.

Quartz — Snapdragon 8 Elite Gen 6

NVIDIA Isaac ROS 5.0 brings AI-agent skills to robotics

At ROSCon Toronto, NVIDIA released Isaac ROS 5.0 (tagged 5.0.0, 21 Sep): free/open packages migrating to ROS 2 Lyrical / Ubuntu 24.04, replacing NITROS with native rosidl::Buffer GPU exchange, and shipping AI-agent skills (open Agent Skills format) so coding assistants can activate envs and migrate nodes. New gpu\_partitioning package uses CUDA MPS to assign SM slices per ROS process. Targets the ~1.3M ROS user base with less plumbing friction.

Isaac ROS 5.0 release notes

Enveda raises $311M Series E at $2B for AI-discovered drugs

Colorado biotech Enveda closed a $311M Series E led by Catalio at a $2B valuation (double year-ago), pushing total funding past $845M. New names include Durable, ICONIQ, Lightspeed, and T. Rowe Price. Proceeds advance ENV-294 (atopic dermatitis) and ENV-308 (metabolic health) after early readouts from its PRISM natural-product AI platform—another large cheque for AI-native drug discovery.

AI Weekly — 23 September roundup