Non-Deterministic Nature of Prompt Injection

As we explained in a previous blogpost, exploiting a prompt injection attack is conceptually easy to understand: There are previous instructions in the prompt, and we include additional instructions within the user input, which is merged together with the legitimate instructions in a way that the underlying model cannot distinguish between them. Just like what […]

attack easy explained exploiting injection injection attack input instructions machine learning nature non prompt prompt injection understand