ChatGPT Systems: Prompt Injection and How to avoid ?

Prompt Injection (definition)

• 
  Prompt injection refers to a technique used in natural language processing (NLP) models, where an attacker manipulates the input prompt to trick the model into generating unintended or biased outputs.

Prompt Injection (example)

• A simple example is in the image bit below, User asks to forget the original instructions and tries to allot it a task of his own will.

Prompt Injection (impact)

• 
  Prompt injection can have serious consequences, such as spreading misinformation, promoting biased views, or …

ai attacker chatgpt deeplearning definition image injection input language machinelearning natural natural language natural language processing nlp prompt prompt injection simple systems