all InfoSec news
A Study of the Attention Abnormality in Trojaned BERTs. (arXiv:2205.08305v1 [cs.CR])
May 18, 2022, 1:20 a.m. | Weimin Lyu, Songzhu Zheng, Tengfei Ma, Chao Chen
cs.CR updates on arXiv.org arxiv.org
Trojan attacks raise serious security concerns. In this paper, we investigate
the underlying mechanism of Trojaned BERT models. We observe the attention
focus drifting behavior of Trojaned models, i.e., when encountering an poisoned
input, the trigger token hijacks the attention focus regardless of the context.
We provide a thorough qualitative and quantitative analysis of this phenomenon,
revealing insights into the Trojan mechanism. Based on the observation, we
propose an attention-based Trojan detector to distinguish Trojaned models from
clean ones. To …
More from arxiv.org / cs.CR updates on arXiv.org
Jobs in InfoSec / Cybersecurity
SOC 2 Manager, Audit and Certification
@ Deloitte | US and CA Multiple Locations
Security Architect - Hardware
@ Intel | IND - Bengaluru
Elastic Consultant
@ Elastic | Spain
OT Cybersecurity Specialist
@ Emerson | Abu Dhabi, United Arab Emirates
Security Operations Program Manager
@ Kaseya | Miami, Florida, United States
Senior Security Operations Engineer
@ Revinate | Vancouver