What Was Your Prompt? A Remote Keylogging Attack on AI Assistants

arXiv:2403.09751v1 Announce Type: new
Abstract: AI assistants are becoming an integral part of society, used for asking advice or help in personal and confidential issues. In this paper, we unveil a novel side-channel that can be used to read encrypted responses from AI Assistants over the web: the token-length side-channel. We found that many vendors, including OpenAI and Microsoft, have this side-channel.
However, inferring the content of a response from a token-length sequence alone proves challenging. This is because tokens …

advice ai assistants arxiv asking attack can channel confidential cs.ai cs.cl cs.cr encrypted keylogging length novel personal prompt side-channel society the web token web