Instructional Fingerprinting of Large Language Models

arXiv:2401.12255v2 Announce Type: replace
Abstract: The exorbitant cost of training Large language models (LLMs) from scratch makes it essential to fingerprint the models to protect intellectual property via ownership authentication and to ensure downstream users and developers comply with their license terms (e.g. restricting commercial use). In this study, we present a pilot study on LLM fingerprinting as a form of very lightweight instruction tuning. Model publisher specifies a confidential private key and implants it as an instruction backdoor that …

arxiv cs.ai cs.cl cs.cr cs.lg fingerprinting language language models large