I re-install go both from official and with brew installer. But there is no difference.

After command : go get -u github.com/tomnomnom/httprobe execute nothing is change. There is no output in terminal also.

Hi,

i have a problem with the Httprobe because not download..

sorry for my english XD

order for install..

Apt install golang (working done) now go get -u github.com/tomnomnom/httprobe (not error message, but dont download anything..)

attached screenshots.

https://ibb.co/c19P9Gb

https://ibb.co/QQYXKfF

upload photos from ImgBB.

Hello tomnomnom!

I have a short question, does httprobe have a max value for concurrency?

i am running it against +200k subdomains and sometimes even more, and it is a little bit slow with -c 50 provided. Is there a max value for the -c flag? any other method to speed this up without breaking everything?

Have a good day.

go version go1.6.2 linux/amd64

PATH is set as follows:

export GOPATH=$HOME/go
export PATH=$PATH:$GOROOT/bin:$GOPATH/bin

~/go$ go get -u github.com/tomnomnom/httprobe
# github.com/tomnomnom/httprobe
src/github.com/tomnomnom/httprobe/main.go:57: unknown http.Transport field 'MaxIdleConns' in struct literal
src/github.com/tomnomnom/httprobe/main.go:58: unknown http.Transport field 'IdleConnTimeout' in struct literal
src/github.com/tomnomnom/httprobe/main.go:64: unknown http.Transport field 'DialContext' in struct literal
src/github.com/tomnomnom/httprobe/main.go:68: undefined: http.ErrUseLastResponse

Currently, if you want to use httprobe and scan additional ports you have to use -p http:<PORT> which is fine for a few ports but for heavy scanning could become tedious.

I added two port templates to allow scanning for non-standard HTTP ports more easily. The idea is taken from aquatone.

The templates I implemented are:

• xlarge for 80, 81, 300, 443, 591, 593, 832, 981, 1010, 1311, 2082, 2087, 2095, 2096, 2480, 3000, 3128, 3333, 4243, 4567, 4711, 4712, 4993, 5000, 5104, 5108, 5800, 6543, 7000, 7396, 7474, 8000, 8001, 8008, 8014, 8042, 8069, 8080, 8081, 8088, 8090, 8091, 8118, 8123, 8172, 8222, 8243, 8280, 8281, 8333, 8443, 8500, 8834, 8880, 8888, 8983, 9000, 9043, 9060, 9080, 9090, 9091, 9200, 9443, 9800, 9981, 12443, 16080, 18091, 18092, 20720, 28017
• large for 80, 81, 443, 591, 2082, 2087, 2095, 2096, 3000, 8000, 8001, 8008, 8080, 8083, 8443, 8834, 8888

So if you want to use the xlarge template for example:

echo api.twitter.com | ./httprobe -p xlarge
http://api.twitter.com
https://api.twitter.com

Hello,

I have been using httprobe for a while and everything is working fine so I decided to add it to my script, when I run the script I get an httprobe command not found. error. Every other tool in the script ( amass, nmap etc) is working fine and I can still use httprobe perfectly from the terminal in any directory (including the directory the script is in). Any thoughts? Thank you.

Hi @tomnomnom,

Thanks for the amazing tool, It really helps in HTTP probing.

As mentioned in the title, can we please have an additional argument if a user wants to print out the hosts which didn't respond or were down during the probing? Would help out in domains that point to a STALE record which is terminated etc.

cat abc.txt | httprobe --prefer-https -c 50

the above command is showing error

cat abc.txt | httprobe
#this command works fine though

I want the result to be either http or https and not both and if https is available I dont want http

The isListening function does not reads http bodies which may & do lead to error saying Too many open file descriptors as the connection does not gets closed. Adding an io.Copy to copy the response to ioutil.Discard solves the problem.

The second thing i did was remove the usage of defer from that code path as calling defer is more expensive than a simple statement.

Currently, the input url must be in the format:

google.com
xyz.com

Pushing code to automatically prepend the HTTP protocol if it is not present, or if its present don't error out, continue with that url.

All the below URL's are valid input now

http://google.com
google.com
https://google.com

Hi Tom,

This pull request addresses the issue that you proposed about specifying a large number of ports being inconvenient given how values passed to the -p option are formatted (#3). The modifications that I made to httprobe allow the following to work:

$ cat domains.txt | httprobe -p 1234
$ cat domains.txt | httprobe -p 1234,4321
$ cat domains.txt | httprobe -p large
$ cat domains.txt | httprobe -p large,1234
$ cat domains.txt | httprobe -p http:1234 -p https:1234,4321
$ cat domains.txt | httprobe -p http:large -p https:xlarge,1234

Determining which ports to probe on each of HTTP and HTTPS now happens only once (when the flags are parsed). Prior to this, httprobe would run a switch case for each host which is a waste of a few CPU cycles (I say this sarcastically :D).

Also note that I made the relevant changes to the README.md file (including what's mentioned in #23).

Best Regards, Adam

To avoid getting massive 404 pages on large scopes I added two new flags:

• -f: Filter the given status code
• - --follow-redirect Use the default redirection policy, following up to a maximum of 10 times

Help on how to install because even after using the command: go install github.com/tomnomnom/httprobe@latest

The is no response from the httprobe in terminal returns: httprobe: command not found

Installing executables with "go get" in module mode is deprecated. "go install pkg@version" should be used instead. For more information, see https://golang.org/doc/go-get-install-deprecation