ToolSimulator: scalable tool testing for AI agents

You can use ToolSimulator, an LLM-powered tool simulation framework within Strands Evals, to thoroughly and safely test AI agents that rely on external tools, at scale. Instead of risking live API...

AWS ML Blog·3d ago

v2.1.86

What's changed Added X-Claude-Code-Session-Id header to API requests so proxies can aggregate requests by session without parsing the body Added .jj and .sl to VCS directory exclusion lists so Grep...

Claude Code Releases·Mar 27

Helping developers build safer AI experiences for teens

OpenAI releases prompt-based teen safety policies for developers using gpt-oss-safeguard, helping moderate age-specific risks in AI systems.

OpenAI·Mar 24

Ensuring AI use in education leads to opportunity

OpenAI shares new tools, certifications, and measurement resources to help schools and universities close AI capability gaps and expand opportunity.

OpenAI·Mar 5

Democratizing AI Safety with RiskRubric.ai

Hugging Face·Sep 18

The Artificiality of Alignment

This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia...

The Gradient·Oct 7

From Risk to Asset: Designing a Practical Data Strategy That Actually Works

by Mike Huls — How to turn data into a strategic asset that enables faster decisions, reduces uncertainty, and helps the organization move toward its goals. The post From Risk to Asset: Designing a Practical Data...

Towards Data Science·3d ago

Protecting people from harmful manipulation

Google DeepMind researches AI's harmful manipulation risks across areas like finance and health, leading to new safety measures.

Google DeepMind·Mar 25

How we monitor internal coding agents for misalignment

How OpenAI uses chain-of-thought monitoring to study misalignment in internal coding agents—analyzing real-world deployments to detect risks and strengthen AI safety safeguards.

OpenAI·Mar 19

Practical Security Guidance for Sandboxing Agentic Workflows and Managing Execution Risk

AI coding agents enable developers to work faster by streamlining tasks and driving automated, test-driven development. However, they also introduce a... AI coding agents enable developers to work...

NVIDIA Developer·Jan 30

Taking a responsible path to AGI

We’re exploring the frontiers of AGI, prioritizing technical safety, proactive risk assessment, and collaboration with the AI community.

Google DeepMind·Apr 2

OpenAI Agents SDK improves governance with sandbox execution

OpenAI is introducing sandbox execution that allows enterprise governance teams to deploy automated workflows with controlled risk. Teams taking systems from prototype to production have faced...

AI News·Apr 16

Introducing the OpenAI Safety Bug Bounty program

OpenAI launches a Safety Bug Bounty program to identify AI abuse and safety risks, including agentic vulnerabilities, prompt injection, and data exfiltration.

OpenAI·Mar 25

Designing AI agents to resist prompt injection

How ChatGPT defends against prompt injection and social engineering by constraining risky actions and protecting sensitive data in agent workflows.

OpenAI·Mar 11

Strengthening our Frontier Safety Framework

We’re strengthening the Frontier Safety Framework (FSF) to help identify and mitigate severe risks from advanced AI models.

Google DeepMind·Oct 23

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Hugging Face·May 24