Recovering the Pre-Fine-Tuning Weights of Generative Models

arXiv:2402.10208v1 Announce Type: cross
Abstract: The dominant paradigm in generative modeling consists of two steps: i) pre-training on a large-scale but unsafe dataset, ii) aligning the pre-trained model with human values via fine-tuning. This practice is considered safe, as no current method can recover the unsafe, pre-fine-tuning model weights. In this paper, we demonstrate that this assumption is often false. Concretely, we present Spectral DeTuning, a method that can recover the weights of the pre-fine-tuning model using a few low-rank …

arxiv can cs.cl cs.cr cs.cv cs.lg current dataset fine-tuning generative generative models human human values large modeling paradigm practice recover safe scale training