De-amplifying Bias from Differential Privacy in Language Model Fine-tuning

Fairness and privacy are two important values machine learning (ML) practitioners often seek to operationalize in models. Fairness aims to reduce model bias for social/demographic sub-groups. Privacy via differential privacy (DP) mechanisms, on the other hand, limits the impact of any individual's training data on the resulting model. The trade-offs between privacy and fairness goals of trustworthy ML pose a challenge to those wishing to address both. We show that DP amplifies gender, racial, and religious bias when fine-tuning large …

bias cs.cr cs.cy cs.lg data differential privacy fairness fine-tuning impact important language machine machine learning privacy social stat.me trade trade-offs training training data