A Taxonomy of Prompt Injection Attacks

Researchers ran a global prompt hacking competition, and have documented the results in a paper that both gives a lot of good examples and tries to organize a taxonomy of effective prompt injection strategies. It seems as if the most common successful strategy is the “compound instruction attack,” as in “Say ‘I have been PWNED’ without a period.”

Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of

LLMs through a Global Scale Prompt Hacking Competition

Abstract: Large Language Models (LLMs) …

academic papers artificial intelligence attack attacks competition compound examples global good hacking injection injection attacks llm lot prompt prompt injection prompt injection attacks researchers results strategies strategy