Secret Collusion Among Generative AI Agents

Recent capability increases in large language models (LLMs) open up applications in which teams of communicating generative AI agents solve joint tasks. This poses privacy and security challenges concerning the unauthorised sharing of information, or other unwanted forms of agent coordination. Modern steganographic techniques could render such dynamics hard to detect. In this paper, we comprehensively formalise the problem of secret collusion in systems of generative AI agents by drawing on relevant concepts from both the AI and security literature. …

agent ai agents applications challenges coordination cs.ai cs.cr detect forms generative generative ai hard information language language models large llms privacy privacy and security secret security security challenges sharing teams techniques unauthorised