Learnable Linguistic Watermarks for Tracing Model Extraction Attacks on Large Language Models

arXiv:2405.01509v1 Announce Type: new
Abstract: In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on signal insertion in model logits or post-processing of generated text, remain largely heuristic. We propose a novel method for embedding learnable linguistic watermarks in LLMs, aimed at tracing and preventing model extraction attacks. Our approach subtly modifies the LLM's output distribution by introducing controlled noise …

artificial artificial intelligence arxiv attacks cs.ai cs.cl cs.cr current domain extraction generated intellectual property intelligence language language models large linguistic llms model extraction property safeguarding signal techniques text tracing watermarking watermarks