Sparse Private LASSO Logistic Regression. (arXiv:2304.12429v1 [cs.LG])

LASSO regularized logistic regression is particularly useful for its built-in
feature selection, allowing coefficients to be removed from deployment and
producing sparse solutions. Differentially private versions of LASSO logistic
regression have been developed, but generally produce dense solutions, reducing
the intrinsic utility of the LASSO penalty. In this paper, we present a
differentially private method for sparse logistic regression that maintains
hard zeros. Our key insight is to first train a non-private LASSO logistic
regression model to determine an appropriate …

deployment hard insight key non private producing solutions train utility