What it is
proxy-scraper-cli is a command-line tool written in Python designed to scrape and verify free HTTP, SOCKS4, and SOCKS5 proxies. It maintains a live list of working proxies and utilizes a rotating proxy server, alongside an MCP server for AI agents.
How it works
The tool collects public HTTP, SOCKS4, and SOCKS5 proxies from over 700 sources. It rigorously verifies every proxy hit using checks such as honeypots, injected scripts, and TLS verification. Based on these checks, the scraper learns which sources are reliable and can consolidate the results into a single rotating proxy.
TWSC experience
Not yet tested by TWSC.
Related
Sources
The Web Scraping Wiki is compiled from the tests and research published on The Web Scraping Club, the newsletter for web scraping professionals. Subscribe to get the next article in your inbox.