LazyDP: Co-Designing Algorithm-Software for Scalable Training of Differentially Private Recommendation Models

arXiv:2404.08847v1 Announce Type: cross
Abstract: Differential privacy (DP) is widely being employed in the industry as a practical standard for privacy protection. While private training of computer vision or natural language processing applications has been studied extensively, the computational challenges of training of recommender systems (RecSys) with DP have not been explored. In this work, we first present our detailed characterization of private RecSys training using DP-SGD, root-causing its several performance bottlenecks. Specifically, we identify DP-SGD's noise sampling and noisy …

algorithm applications arxiv challenges computational computer computer vision cs.cr cs.ir cs.lg differential privacy industry language natural natural language natural language processing privacy private protection recommender systems software standard systems training