all InfoSec news
Xcrawl3R - A CLI Utility To Recursively Crawl Webpages
Aug. 11, 2023, 12:30 p.m. | noreply@blogger.com (Unknown)
KitPloit - PenTest Tools! www.kitploit.com
xcrawl3r
is a command-line interface (CLI) utility to recursively crawl webpages i.e systematically browse webpages' URLs and follow links to discover linked webpages' URLs.
Features
- Recursively crawls webpages for URLs.
- Parses URLs from files (
.js
,.json
,.xml
,.csv
,.txt
&.map
). - Parses URLs from
robots.txt
. - Parses URLs from sitemaps.
- Renders pages (including Single Page Applications such as Angular and React).
- Cross-Platform (Windows, Linux & macOS)
Installation
Install release binaries (Without Go Installed)
Visit …
bug bounty tools contentdiscovery ethical hacking tools penetration testing tools red teaming red teaming tools
More from www.kitploit.com / KitPloit - PenTest Tools!
Galah - An LLM-powered Web Honeypot Using The OpenAI API
5 days, 15 hours ago |
www.kitploit.com
CSAF - Cyber Security Awareness Framework
1 week, 1 day ago |
www.kitploit.com
Jobs in InfoSec / Cybersecurity
DevSecOps Engineer
@ Material Bank | Remote
Instrumentation & Control Engineer - Cyber Security
@ ASSYSTEM | Bridgwater, United Kingdom
Security Consultant
@ Tenable | MD - Columbia - Headquarters
Management Consultant - Cybersecurity - Internship
@ Wavestone | Hong Kong, Hong Kong
TRANSCOM IGC - Cybersecurity Engineer
@ IT Partners, Inc | St. Louis, Missouri, United States
Manager, Security Operations Engineering (EMEA)
@ GitLab | Remote, EMEA