Adversarial Prompts

Techniques that manipulate inputs to induce unsafe or undesired model behavior.

Articles about Adversarial Prompts

A.I
Militant Groups Embrace AI Tools

Militant Groups Embrace AI Tools
National security officials say Islamic State affiliates and other extremist groups are experimenting with generative AI for propaganda, cyberattacks and translation — a threat th…
A.I
Senators Warn After AI-Driven Cyberattack

Senators Warn After AI-Driven Cyberattack
Bipartisan senators have pressed the federal government after Anthropic disclosed an AI-driven cyber campaign that targeted 30 organizations and reportedly ran largely autonomousl…
A.I
When Poetry Breaks AI

When Poetry Breaks AI
Researchers show that carefully written verse can reliably bypass safety filters in many top language models, exposing a new, style-based class of jailbreaks and challenging curre…