Indirect Prompt Injection Into LLMs Using Images and Sounds

Multi-modal Large Language Models (LLMs) are advanced artificial intelligence models that can produce contextually rich responses that combine inputs of various types (text, audio, pictures). As a result, Bard already relies on such architecture, and the next generation of ChatGPT is expected to rely on them as well.

In this talk, we demonstrate how images and audio samples can be used for indirect prompt and instruction injection against (unmodified and benign) multi-modal LLMs. An attacker generates an adversarial perturbation corresponding …

advanced architecture artificial artificial intelligence audio bard can chatgpt images injection inputs intelligence language language models large llms modal next pictures prompt prompt injection result text types