SecretScraper: highly configurable web crawler/scraper for extracting sensitive data from websites

Hi, I'm a cybersecurity enthusiastic. And I've made a web crawler/scraper tool to extract links and sensitive information against target websites. You can find it here: [https://github.com/PadishahIII/SecretScraper](https://github.com/PadishahIII/SecretScraper).

**What My Project Does**

*SecretScraper* is a highly configurable web scraper tool that crawls links, extracts subdomains from target websites and finds sensitive data using regular expressions. The features included in the *SecretScraper* are:

* Web crawler: extract links using both DOM hierarchy and regex
* Support for domain whitelist and blacklist
* …

crawler cybersecurity data dom domain expressions extract features hierarchy links project regex regular regular expressions scraper sensitive sensitive data subdomains support target tool urls web websites whitelist