What it is

FireHOL is a community-driven project that aggregates multiple IP lists to help defenders block known malicious or unwanted traffic. While originally built as a firewall management tool, it is now best known for its curated threat intelligence feeds, including lists of open proxies, Tor exit nodes, and known spam sources. The firehol_proxies list is a feed updated daily that combines several open proxy datasets such as ip2proxy_px1lite, socks_proxy_30d, and sslproxies_30d.

How it works

FireHOL functions by aggregating various IP lists to provide defenders with resources for blocking unwanted traffic. The specific proxy list benchmarked, firehol_proxies, is compiled from several open proxy datasets.

TWSC experience

Not yet tested by TWSC.

Known limitations

Defenders relying solely on public feeds, such as FireHOL’s proxy list, are likely to miss large segments of fast-moving or evasive proxy traffic. The FireHOL proxy list shows very limited coverage of residential and ISP proxies compared to proprietary databases.

Sources


The Web Scraping Wiki is compiled from the tests and research published on The Web Scraping Club, the newsletter for web scraping professionals. Subscribe to get the next article in your inbox.