The Internet with Privacy Policies: Measuring The Web Upon Consent. (arXiv:2109.00395v2 [cs.CR] UPDATED)

To protect users' privacy, legislators have regulated the usage of tracking
technologies, mandating the acquisition of users' consent before collecting
data. Consequently, websites started showing more and more consent management
modules -- i.e., Privacy Banners -- the visitors have to interact with to
access the website content. They challenge the automatic collection of Web
measurements, primarily to monitor the extensiveness of tracking technologies
but also to measure Web performance in the wild. Privacy Banners in fact limit
crawlers from observing …

consent internet policies privacy the web web