Proxlist - Retrieve proxy servers.

Last update: Mar 17, 2022

Overview

Proxlist

Retrieve proxy servers.

Finding and storing a list of proxies can be taxing - especially ones that are free and may not work only minutes from now. proxlist will validate the proxy and return a rotating random proxy to you so you don't need to keep a list of proxies or ensure it's contents are still valid.

Proxies are returned in the form of strings (eg: ip:port).

These proxies come from all over the world and may not be performant for a production application. This package (for now) is intended for testing purposes and I make no guarantee about where the data sent through these proxies goes or how it's handled. The list of proxies rotates rapidly and is free and open source.

Install

# Install tool
pip3 install proxlist

# Install locally
make install

Usage

import proxlist
import requests

proxy = proxlist.random_proxy()

# Alternatively, you could get the entire list of configured proxies
# proxies = proxlist.list_proxies()

proxies = {
    'http': f'http://{proxy}',
    'https': f'http://{proxy}',
}

# Depending on the proxy and you location in the world, you may need to adjust the timeout
# to provide the proxy enough time to route your request.
response = requests.get('https://google.com', proxies=proxies, timeout=15)
print(response.text)

Development

# Get a comprehensive list of development tools
make help

a safe proxy over tls

TlsProxys 基于TLS协议的http流量代理安装 ※ 需要python3.7+ linux: python3.9 -m pip install TlsProxys windows: pip install TlsProxys 基本用法服务器端: $ tpserver [command]

56 Nov 30, 2022

sshuttle: where transparent proxy meets VPN meets ssh

Transparent proxy server that works as a poor man's VPN. Forwards over ssh. Doesn't require admin. Works with Linux and MacOS. Supports DNS tunneling.

9.4k Jan 9, 2023

Cobalt Strike C2 Reverse proxy that fends off Blue Teams, AVs, EDRs, scanners through packet inspection and malleable profile correlation

715 Dec 25, 2022

Fast and configurable script to get and check free HTTP, SOCKS4 and SOCKS5 proxy lists from different sources and save them to files

Fast and configurable script to get and check free HTTP, SOCKS4 and SOCKS5 proxy lists from different sources and save them to files. It can also get geolocation for each proxy and check if proxies are anonymous.

385 Dec 31, 2022

A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.

929 Jan 1, 2023

A SOCKS proxy server implemented with the powerful python cooperative concurrency framework asyncio.

asyncio-socks-server A SOCKS proxy server implemented with the powerful python cooperative concurrency framework asyncio. Features Supports both TCP a

164 Dec 30, 2022

CORS Bypass Proxy Cloud Function

1 Oct 23, 2021

A python tool auto change proxy or ip after dealy time set by user

Auto proxy Ghost This tool auto change proxy or ip after dealy time set by user how to run 1. Install required file ./requirements.sh 2.Enter command

0 Feb 23, 2022

A script to automatically update the github's proxy IP in hosts file.

updateHostsGithub A script to automatically update the github's proxy IP in hosts file. Now only Mac and Linux are supported. (脚本自动更新本地hosts文件,目前仅支持Ma

2 Jul 6, 2022

Comments

fix: use better validation for new proxy list

Adds better validation for new proxy list. Each proxy needed to correctly serve 3 unique requests, if it couldn't do all three (previously only one) it didn't make the cut.

Also moved the list to a txt file for now for better management. This may continue to change over time.

opened by Justintime50 0

Releases(v0.5.0)

v0.5.0(Mar 5, 2022)
Adds concurrency to speed up validating proxies. This brings finding a valid proxy from ~1.5 minutes down to just ~4-20 seconds depending on the available proxies at the time

Bumps thread count from 10 to 20

Bumps timeout to validate a proxy from 0.5 to 1 second with no filters and 3 to 2 seconds with filters

Exposes list_proxies and validate_proxy functions which were previously internal

Adds timers to test results and brings coverage to 100%

Source code(tar.gz)
Source code(zip)
v0.4.0(Feb 11, 2022)
Adds debug logging

Fixes a bug that would choose an incorrect random proxy after finding a verified entry, this fix greatly increases the reliability of this package

Other small improvements to increase performance

Source code(tar.gz)
Source code(zip)
v0.3.0(Dec 8, 2021)
Adds country parameter to filter proxies by their two digit ISO country codes

Adds google_verified parameter to filter proxies by if they are google verified or not

Adds altered timeout logic (shorter timeouts for larger proxy pools to get to a working proxy faster, longer timeouts when the proxy pool is smaller to offset the difference and get a working proxy back to you)

Source code(tar.gz)
Source code(zip)
v0.2.1(Dec 8, 2021)
Have a stricter validation timeout of 1 second instead of 3 seconds to improve performance and accuracy based on your connection and location

Source code(tar.gz)
Source code(zip)
v0.2.0(Dec 8, 2021)
Removes proxy list from repo entirely

Retrieves an updated proxy list each time you request a proxy

Tests that the proxy works prior to returning it to you

Source code(tar.gz)
Source code(zip)
v0.1.1(Dec 8, 2021)
Overhauls the proxy list with different proxies (tested more thoroughly) as well as moves the list from a hardcoded constant to a text file

Source code(tar.gz)
Source code(zip)
v0.1.0(Dec 7, 2021)

Initial release allowing you to retrieve a random proxy or a list of proxies from a small initial list
Source code(tar.gz)
Source code(zip)

Owner

Justin Hammond

Software Engineer @EasyPost. I love all things tech. I've been programming since the age of 12, repairing iPhones since 16, and founding tech companies since 20

GitHub