Dynamic Efficient Adversarial Training Guided by Gradient Magnitude. (arXiv:2103.03076v2 [cs.LG] UPDATED)

Web: http://arxiv.org/abs/2103.03076

Adversarial training is an effective but time-consuming way to train robust
deep neural networks that can withstand strong adversarial attacks. As a
response to its inefficiency, we propose Dynamic Efficient Adversarial Training
(DEAT), which gradually increases the adversarial iteration during training. We
demonstrate that the gradient's magnitude correlates with the curvature of the
trained model's loss landscape, allowing it to reflect the effect of
adversarial training. Therefore, based on the magnitude of the gradient, we
propose a general acceleration strategy, …

adversarial dynamic magnitude training