domhttpx is a google search engine dorker with HTTP toolkit built with python, can make it easier for you to find many URLs/IPs at once with fast time.

Naufal Ardhani

Last update: Dec 4, 2022

Related tags

Third-party APIs Wrappers python search-engine google http-client python3 penetration-testing dorker httpx

Overview

domhttpx is a google search engine dorker with HTTP toolkit built with python, can make it easier for you to find many URLs/IPs at once with fast time.

Install
Usage
Running Example
Help & Bugs
Thanks

Install

> git clone https://github.com/naufalardhani/domhttpx.git
> cd domhttpx 
> pip3 install -r requirements.txt
> python3 domhttpx.py --help

Usage

Flags

This will display help for the tool. Here are all the switches it supports.

Flag	Description	Example
-ip, --only-ip	Show output as IP only	domhttpx --only-ip
-od, --only-domain	Show output as domain only	domhttpx --only-domain
-rp, --real-path	Extract real path	domhttpx -k [keyword] -a [amount] --real-path
-p, --path	Custom path url	domhttpx -k [keyword] -a [amount] --path [custom_path]
-sc, --status-code	Extract status code	domhttpx -k [keyword] -a [amount] --status-code
-t, --title	Extract title page	domhttpx -k [keyword] -a [amount] --title
-ws, --web-server	Extract web server	domhttpx -k [keyword] -a [amount] --server
-cr, --check-result	Check list result	domhttpx --check-result
-sr, --show-result	Show result content	domhttpx --show-result result.txt
-rr, --remove-result	Remove result file	domhttpx --remove-result result.txt
-o, --output	File to write output	domhttpx -k [keyword] -a [amount] -o output.txt
-s, --silent	Show only subdomains in output	domhttpx -k [keyword] -a [amount] --silent
-v, --version	Show current program version	domhttpx --version

Basic Usage

> domhttpx.py --keyword [keyword] --amount [amount]

One keyword

> domhttpx.py --keyword pentesting --amount 5

Multiple keyword

> domhttpx.py --keyword "pentesting basic" --amount 5

Extract Title Page

> domhttpx.py --keyword "pentesting basic" --amount 5 --title

Extract Title Page from Real Path

> domhttpx.py --keyword "pentesting basic" --amount 5 --title --real-path

Extract Web Server

> domhttpx.py --keyword "pentesting basic" --amount 5 --web-server

Running Example

Running domHttpx with default command

This will run an automatic search tool with the specified keyword and number

➤ domhttpx.py --keyword indonesia --amount 20     

     _           _  _ _   _
  __| |___ _ __ | || | |_| |_ _ ____ __
 / _` / _ \ '  \| __ |  _|  _| '_ \ \ /
 \__,_\___/_|_|_|_||_|\__|\__| .__/_\_\
                             |_| v1.0.0

            naufalardhani.com

https://www.suara.com
https://www.suara.com
https://www.suara.com
https://en.wikipedia.org
https://en.wikipedia.org
https://en.wikipedia.org
https://en.wikipedia.org
https://en.wikipedia.org
https://id.wikipedia.org
https://id.wikipedia.org
https://id.wikipedia.org
https://id.wikipedia.org
https://id.wikipedia.org
https://www.indonesia.travel
https://www.britannica.com
https://indonesia.go.id
https://www.garuda-indonesia.com
https://wikitravel.org
https://www.aljazeera.com
https://www.worldbank.org


[INFO] Searching domain for indonesia keyword
[INFO] Found 20 domain

Show output as IP

➤ domhttpx.py --keyword indonesia --amount 9 --only-ip

     _           _  _ _   _
  __| |___ _ __ | || | |_| |_ _ ____ __
 / _` / _ \ '  \| __ |  _|  _| '_ \ \ /
 \__,_\___/_|_|_|_||_|\__|\__| .__/_\_\
                             |_| v1.0.0

            naufalardhani.com

54.192.146.34
103.102.166.224
104.93.220.176
104.18.19.221
202.89.117.193
104.18.11.196
172.67.161.37
104.93.115.155
199.232.44.143


[INFO] Searching IP for indonesia keyword
[INFO] Found 9 IP

Extracts the real path

➤ domhttpx.py --keyword indonesia --amount 9 --real-path

     _           _  _ _   _
  __| |___ _ __ | || | |_| |_ _ ____ __
 / _` / _ \ '  \| __ |  _|  _| '_ \ \ /
 \__,_\___/_|_|_|_||_|\__|\__| .__/_\_\
                             |_| v1.0.0

            naufalardhani.com

https://www.suara.com/entertainment/2021/07/01/211333/6-aktor-indonesia-main-di-film-hollywood-tak-cuma-andalkan-tampang
https://en.wikipedia.org/wiki/Indonesia
https://www.indonesia.travel/id/en/home
https://www.britannica.com/place/Indonesia
https://indonesia.go.id/
https://www.garuda-indonesia.com/
https://wikitravel.org/en/Indonesia
https://www.aljazeera.com/where/indonesia/
https://www.lonelyplanet.com/indonesia


[INFO] Searching domain for indonesia keyword
[INFO] Found 9 domain

Extracts status code

➤ domhttpx.py --keyword "Indonesia Basketball League" --amount 10 --status-code 

     _           _  _ _   _
  __| |___ _ __ | || | |_| |_ _ ____ __
 / _` / _ \ '  \| __ |  _|  _| '_ \ \ /
 \__,_\___/_|_|_|_||_|\__|\__| .__/_\_\
                             |_| v1.0.0

            naufalardhani.com

https://en.wikipedia.org [200]
https://iblindonesia.com [200]
https://iblindonesia.com [200]
https://iblindonesia.com [200]
https://iblindonesia.com [200]
https://iblindonesia.com [200]
https://twitter.com [200]
https://twitter.com [200]
https://en.wikipedia.org [200]
https://en.wikipedia.org [200]


[INFO] Searching domain for Indonesia Basketball League keyword
[INFO] Found 10 domain

Extracts title page

➤ domhttpx.py --keyword "Ananta Dandy" --amount 10 --real-path --title              

     _           _  _ _   _
  __| |___ _ __ | || | |_| |_ _ ____ __
 / _` / _ \ '  \| __ |  _|  _| '_ \ \ /
 \__,_\___/_|_|_|_||_|\__|\__| .__/_\_\
                             |_| v1.0.0

            naufalardhani.com

https://www.dbl.id/camp/1/campers/98/ananta-dandy [Campers - Ananta Dandy]
https://www.dbl.id/u/profile/12379/ananta-dandy [Ananta Dandy Profile | DBL ID]
https://www.instagram.com/anantadandy/?hl=en [Page Not Found • Instagram]
https://play.fiba3x3.com/players/d3a6cc16-fd25-424d-a3a4-62515c5cd075 [Ananta Dandy]
https://www.youtube.com/watch?v=DghZd7E3YL0 [Ananta Dandy  - Rakan - Rafie - Saddam & Zee Bikin Komunitas #Basket Komplek | Isinya Jagoan Semua ! - YouTube]
https://www.youtube.com/watch?v=J4oOSmfOlmA [Next in Line #12: Ananta Dandy Tentang Bermain melawan Filipin & Motivasi Untuk Juara DBL. - YouTube]
https://www.youtube.com/watch?v=A4xu1aMWCy0 [ANANTA DANDY DAN MUHAMAD HAFIZH | DYNAMIC DUO DARI SMAN 71 JAKARTA - YouTube]
https://archive.fiba.com/pages/eng/fa/player/p/pid/137281/sid/13264/tid/302/tid2//_/2017_SEABA_U16_Championship_for_Men/index.html [Ananta Dandy Putra Tarigan's profile | 2017 SEABA U16 Championship for Men | ARCHIVE.FIBA.COM]
http://sman71.sch.id/2020/08/data-sementara-alumni-siswa-sman-71-tahun-2020-yang-diterima-di-ptn/ [Data Sementara Alumni Siswa SMAN 71 Tahun 2020 yang Diterima di PTN – SMAN 71]
https://www.mainbasket.com/r/6522/muhamad-hafizh-gua-ingin-jadi-pemain-indonesia-pertama-di-nba [Muhamad Hafizh: Gua Ingin Jadi Pemain Indonesia Pertama di NBA - mainbasket.com]


[INFO] Searching domain for Ananta Dandy keyword
[INFO] Found 10 domain

Help & Bugs

If you are still confused or find a bug, please open the issue. All bug reports are appreciated, and will be responded to as soon as possible thanks!

Thanks

@MarioVilas - domhttpx uses dorker from the googlesearch package made by him
@projectdiscovery - because I was inspired by their project which is httpx, that's why I made domhttpx
@p4kl0nc4t - who has given many solutions in making domHttpx

Comments

Error 'Traceback (most recent call last)'

Hi, Domhttpx was working fine before. However today I am not able to run any query. Please see the error message below:

Traceback (most recent call last): File "/home/canvas/domhttpx/domhttpx.py", line 9, in main() File "/home/canvas/domhttpx/domHttpx/cli.py", line 80, in main init.show() File "/home/canvas/domhttpx/domHttpx/domHttpx.py", line 127, in show dom_result = self.get_real_path() File "/home/canvas/domhttpx/domHttpx/domHttpx.py", line 57, in get_real_path self.dork() File "/home/canvas/domhttpx/domHttpx/domHttpx.py", line 33, in dork for result in results: File "/usr/local/lib/python3.9/dist-packages/googlesearch/init.py", line 305, in search html = get_page(url, user_agent, verify_ssl) File "/usr/local/lib/python3.9/dist-packages/googlesearch/init.py", line 174, in get_page response = urlopen(request) File "/usr/lib/python3.9/urllib/request.py", line 214, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python3.9/urllib/request.py", line 523, in open response = meth(req, response) File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response response = self.parent.error( File "/usr/lib/python3.9/urllib/request.py", line 555, in error result = self._call_chain(*args) File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain result = func(*args) File "/usr/lib/python3.9/urllib/request.py", line 747, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/usr/lib/python3.9/urllib/request.py", line 523, in open response = meth(req, response) File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response response = self.parent.error( File "/usr/lib/python3.9/urllib/request.py", line 561, in error return self._call_chain(*args) File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain result = func(*args) File "/usr/lib/python3.9/urllib/request.py", line 641, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 429: Too Many Requests

opened by FanCanvas 0
PEP8 compliance

It would be nice to refactor the codebase and make it comply to PEP8 as long as it is still backwards compatible.

Rationale (quoting from the PEP8 page):

One of Guido's key insights is that code is read much more often than it is written. The guidelines provided here are intended to improve the readability of code and make it consistent across the wide spectrum of Python code. As PEP 20 says, "Readability counts".

opened by p4kl0nc4t 0
urllib.error.HTTPError: HTTP Error 429: Too Many Requests

I've received this error after installing it on my server. I've found that if your IP is suspected from Google and needs to solve captcha you will have this error.

The problem solved after changing my IP.

opened by seqrity 0
UnboundLocalError: local variable 'show' referenced before assignment

Traceback (most recent call last): File "/data/data/com.termux/files/home/information-gathering/domhttpx/domhttpx.py", line 9, in main() File "/data/data/com.termux/files/home/information-gathering/domhttpx/domHttpx/cli.py", line 80, in main init.show() File "/data/data/com.termux/files/home/information-gathering/domhttpx/domHttpx/domHttpx.py", line 162, in show if 'http' not in show: UnboundLocalError: local variable 'show' referenced before assignment

Only appears when using -ws

opened by Omicron166 0
remove the duplicate results

when the tool has finished searching, remove the duplicate urls. if the result is less than "amount" do the search again until it reaches the inputted amount

opened by gibran-abdillah 1