python-website-crawler
discovering subdomains, hidden paths, extracting unique links
pip install -r requirements.txt
- discover subdomain:
You can give the domain name you want to find the subdomain to "target_url"(without http/https) in crawler.oy
$ python crawler.py
- discover directory files:
You can give the domain name you want to find the subdomain to "target_url"(without http/https) in discover-directory.py
$ python discover-directory.py