Prompt Stealing Attacks Against Large Language Models

arXiv:2402.12959v1 Announce Type: new
Abstract: The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in expert prompt engineers and educational resources rising to meet market demand, designing high-quality prompts has become an intriguing challenge. In this paper, we propose a novel attack against LLMs, named prompt stealing attacks. Our proposed prompt stealing attack aims to steal …

arxiv attacks chatgpt companies cs.cl cs.cr demand educational educational resources engineering engineers expert high investing language language models large llms market prompt prompts quality resources rising stealing technology