ramsy0dev/proxycrawler

A light weight proxy crawler and validator

proxycrawler's Issues

Enhacement: save the validated proxies after each request to the geonode's API

The way we retrieve proxies from Geonode.com is by sending requests to it's API, over 100 requests are sent and each of them results in the discovery of over 500 proxies, we need to save the validated proxies resulted from each request when --enable-save-on-run is enabled instead of waiting for all the requests to be done because it will take along time to finish. And this will help in scenarios where the internet connection is a problem or when the user doesn't have the time to wait for everything to be done.