Hello,

would it be possible for you, to add a function, which checks the actual download and upload speed from the proxys? Like this you could always take the fastest proxy from the output and use it.

Thank you

F:\proxy>python main.py https://api.proxyscrape.com/v2/?request=getproxies&protocol=http | No proxies found | Status code 403 https://api.proxyscrape.com/v2/?request=getproxies&protocol=socks4 | No proxies found | Status code 403 https://api.proxyscrape.com/v2/?request=getproxies&protocol=socks5 | No proxies found | Status code 403 https://raw.githubusercontent.com/hanwayTech/free-proxy-list/main/socks5.txt | No proxies found https://raw.githubusercontent.com/hanwayTech/free-proxy-list/main/socks4.txt | No proxies found https://proxysearcher.sourceforge.net/Proxy%20List.php?type=socks | No proxies found https://raw.githubusercontent.com/hanwayTech/free-proxy-list/main/https.txt | No proxies found https://raw.githubusercontent.com/hanwayTech/free-proxy-list/main/http.txt | No proxies found https://proxysearcher.sourceforge.net/Proxy%20List.php?type=socks | No proxies found Traceback (most recent call last): File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\runners.py", line 44, in run return loop.run_until_complete(main) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 628, in run_until_complete self.run_forever() File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 595, in run_forever self._run_once() File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 1845, in _run_once event_list = self._selector.select(timeout) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\selectors.py", line 324, in select r, w, _ = self._select(self._readers, self._writers, [], timeout) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\selectors.py", line 315, in _select r, w, x = select.select(r, w, w, timeout) ValueError: too many file descriptors in select()

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "F:\proxy\main.py", line 403, in asyncio.run(main()) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\runners.py", line 47, in run _cancel_all_tasks(loop) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\runners.py", line 63, in _cancel_all_tasks loop.run_until_complete(tasks.gather(*to_cancel, return_exceptions=True)) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 628, in run_until_complete self.run_forever() File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 595, in run_forever self._run_once() File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 1845, in _run_once event_list = self._selector.select(timeout) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\selectors.py", line 324, in select r, w, _ = self._select(self._readers, self._writers, [], timeout) File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\selectors.py", line 315, in _select r, w, x = select.select(r, w, w, timeout) ValueError: too many file descriptors in select() Scraper :: HTTP ---------------------------------------- 100% 42/42 Scraper :: SOCKS4 ---------------------------------------- 100% 21/21 Scraper :: SOCKS5 ---------------------------------------- 100% 23/23 Checker :: HTTP ---------------------------------------- 0% 0/21368 Checker :: SOCKS4 ---------------------------------------- 0% 0/7759 Checker :: SOCKS5 ---------------------------------------- 0% 0/4395 Exception ignored in: <coroutine object main at 0x0000020784BB02E0> Traceback (most recent call last): File "F:\proxy\main.py", line 369, in main File "F:\proxy\main.py", line 316, in main File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\progress.py", line 1178, in exit File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\progress.py", line 1164, in stop File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\live.py", line 147, in stop File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\console.py", line 869, in exit File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\console.py", line 827, in _exit_buffer File "C:\Users\Users\AppData\Local\Programs\Python\Python310\lib\site-packages\rich\console.py", line 2017, in _check_buffer ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in: <coroutine object Proxy.check at 0x0000020784BB3BC0> Traceback (most recent call last): File "F:\proxy\main.py", line 242, in check_proxy RuntimeError: coroutine ignored GeneratorExit Exception ignored in: <coroutine object Proxy.check at 0x0000020784CE8350> Traceback (most recent call last):

New sources would be nice, kinda hidden github lists or hidden proxy website's would be nice to add to the sources tab. For socks theres not many sources

Exception in callback _ProactorBasePipeTransport._call_connection_lost(None) handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)> Traceback (most recent call last): File "C:\Users\Administrator\AppData\Local\Programs\Python\Python38\lib\asyncio\events.py", line 81, in _run self._context.run(self._callback, *self._args) File "C:\Users\Administrator\AppData\Local\Programs\Python\Python38\lib\asyncio\proactor_events.py", line 162, in _call_connection_lost self._sock.shutdown(socket.SHUT_RDWR) ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

Thank you first of all.

I wonder if possible to save proxies before checking them. I mean is there any way to have 3 additional outputs like http_pre.txt sock4_pre.txt and socks5_pre.txt?

Getting https://raw.githubusercontent.com/clarketm/proxy-list/master/proxy-list-raw.txt Getting https://raw.githubusercontent.com/TheSpeedX/PROXY-List/master/http.txt Getting https://raw.githubusercontent.com/mmpx12/proxy-list/master/http.txt
Getting https://raw.githubusercontent.com/mmpx12/proxy-list/master/https.txt
Getting https://raw.githubusercontent.com/ShiftyTR/Proxy-List/master/https.txt Getting https://raw.githubusercontent.com/ShiftyTR/Proxy-List/master/http.txt Getting https://api.proxyscrape.com/v2/?request=getproxies&protocol=http
Checking proxies... Traceback (most recent call last): File "d:/proxy-scraper-checker-main/main.py", line 70, in t.start() File "C:\Python38-32\lib\threading.py", line 852, in start _start_new_thread(self._bootstrap, ()) RuntimeError: can't start new thread

Hi bro!! Thank you very much for your project.

I want report, i have this problem.

Describe the bug It always shows [WinError 10054] when run, i try set the MaxConnections = 800 but get the same result.

Technical information

• OS: Windows 10
• Python version:
• Output of pip freeze:

aiohttp==3.8.3
aiohttp-socks==0.7.1
aiosignal==1.2.0
asgiref==3.5.2
async-timeout==4.0.2
attrs==22.1.0
certifi==2022.9.24
cffi==1.15.1
charset-normalizer==2.1.1
commonmark==0.9.1
Django==4.1.3
django-embed-video==1.4.8
easy-thumbnails==2.8.3
frozenlist==1.3.1
idna==3.4
multidict==6.0.2
numpy==1.23.5
pandas==1.5.2
paperclip==2.6.1
Pillow==9.3.0
prettytable==3.5.0
pycares==4.2.2
pycparser==2.21
Pygments==2.13.0
PyPDF4==1.27.0
pyperclip==1.8.2
python-dateutil==2.8.2
python-socks==2.0.3
pytz==2022.6
pywin32==304
requests==2.28.1
rich==12.6.0
six==1.16.0
sqlparse==0.4.3
tabulate==0.9.0
tzdata==2022.7
urllib3==1.26.13
vboxapi==1.0
wcwidth==0.2.5
yarl==1.8.1

Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto
Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 162, in _call_connection_lost
    self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] Se ha forzado la interrupción de una conexión existente por el host remoto

What should I do?

hello sir, i changed api link url with http://ip-api.com/json/?fields=country,regionName,city,mobile,proxy,hosting,query then in main.py line 62 i added data["country"], data["regionName"], data["city"],data["mobile"], data["proxy"], data["hosting"]

i want to add new output ie. mobile, proxy and hosting

the app runs but there are some errors, and when done the result is still the same

Hello there,

Check this site https://geonode.com/free-proxy-list/ they contain usually a good bunch of good proxies, is it possible to implement it as well?

when i debuged connection , i found out that custom user agent function is not working

did user agent scraping too for making it sure there is problem from checker side

api working properly(using browser):

please add support for https://spys.one/en/free-proxy-list/ https://proxypremium.top/ here is example scraping script from spys.one https://github.com/motebaya/socks5-proxy/blob/main/main.py