Syntactic Ghost: An Imperceptible General-purpose Backdoor Attacks on Pre-trained Language Models

arXiv:2402.18945v1 Announce Type: new
Abstract: Pre-trained language models (PLMs) have been found susceptible to backdoor attacks, which can transfer vulnerabilities to various downstream tasks. However, existing PLM backdoors are conducted with explicit triggers under the manually aligned, thus failing to satisfy expectation goals simultaneously in terms of effectiveness, stealthiness, and universality. In this paper, we propose a novel approach to achieve invisible and general backdoor implantation, called \textbf{Syntactic Ghost} (synGhost for short). Specifically, the method hostilely manipulates poisoned samples with …

arxiv attacks backdoor backdoor attacks backdoors can cs.ai cs.cl cs.cr explicit found general ghost goals language language models purpose terms transfer under vulnerabilities