Summary of an article published on The Web Scraping Club on 2022-11-04 (free to read). Read the full article
Proxies are a commodity on paper, but anyone scraping at scale knows that ban rates, IP sourcing and provider reliability decide whether a project works. The proxy market is also crowded and under suspicion, because some players source residential IPs in ways that would not pass a serious review. That affects both the vendors and the people who buy from them.
For our monthly interview I spoke with Neil Emeigh, CEO of Rayobyte, formerly Blazing SEO. We talked about how he went from proxy user to provider, whether the industry is consolidating, and what makes a proxy company stand out beyond price. We covered what ethics means for usage and for acquisition, especially for residential IPs, and how SDK-based models might face a crackdown from Apple or Google. I also asked about the hardest technical problem on his side, and Neil shares a story from his career that I did not expect. He closes with advice for anyone starting a proxy business today.
What’s inside
- Why large scraping customers buy from several providers at once, and what that means for new entrants
- Why data center proxies still sold well for years, and why they are now going out of style
- Two sides of ethics in proxies: what customers use the IPs for, and how the IPs are acquired
- Why IP diversity across subnets and ASNs is harder to keep than raw IP volume
In the full article: Neil’s complete answers, the conditions he sets for residential IP use, his view on SDK regulation, the FBI story from 2018 and his practical tips on IP leasing and ASN choice.