Dr. Jekyll and Mr. Hyde: Two Faces of LLMs

arXiv:2312.03853v2 Announce Type: replace
Abstract: Only a year ago, we witnessed a rise in the use of Large Language Models (LLMs), especially when combined with applications like chatbot assistants. Safety mechanisms and specialized training procedures are implemented to prevent improper responses from these assistants. In this work, we bypass these measures for ChatGPT and Bard (and, to some extent, Bing chat) by making them impersonate complex personas with opposite characteristics as those of the truthful assistants they are supposed to …

applications arxiv bypass chatbot cs.cr cs.lg language language models large llms procedures safety training work