Differentially Private Stream Processing at Scale

arXiv:2303.18086v2 Announce Type: replace
Abstract: We design, to the best of our knowledge, the first differentially private (DP) stream aggregation processing system at scale. Our system -- Differential Privacy SQL Pipelines (DP-SQLP) -- is built using a streaming framework similar to Spark streaming, and is built on top of the Spanner database and the F1 query engine from Google.
Towards designing DP-SQLP we make both algorithmic and systemic advances, namely, we (i) design a novel (user-level) DP key selection algorithm …

aggregation arxiv best of cs.cr cs.db database design differential privacy framework knowledge pipelines privacy private scale spark sql stream streaming system