URLBERT:A Contrastive and Adversarial Pre-trained Model for URL Classification

arXiv:2402.11495v1 Announce Type: new
Abstract: URLs play a crucial role in understanding and categorizing web content, particularly in tasks related to security control and online recommendations. While pre-trained models are currently dominating various fields, the domain of URL analysis still lacks specialized pre-trained models. To address this gap, this paper introduces URLBERT, the first pre-trained representation learning model applied to a variety of URL classification or detection tasks. We first train a URL tokenizer on a corpus of billions of …

adversarial arxiv classification cs.cr cs.lg url