Summary of an article published on The Web Scraping Club on 2022-11-04 (free to read). Read the full article

Proxies are a commodity on paper, but anyone scraping at scale knows that ban rates, IP sourcing and provider reliability decide whether a project works. The proxy market is also crowded and under suspicion, because some players source residential IPs in ways that would not pass a serious review. That affects both the vendors and the people who buy from them.

For our monthly interview I spoke with Neil Emeigh, CEO of Rayobyte, formerly Blazing SEO. We talked about how he went from proxy user to provider, whether the industry is consolidating, and what makes a proxy company stand out beyond price. We covered what ethics means for usage and for acquisition, especially for residential IPs, and how SDK-based models might face a crackdown from Apple or Google. I also asked about the hardest technical problem on his side, and Neil shares a story from his career that I did not expect. He closes with advice for anyone starting a proxy business today.

What’s inside

  • Why large scraping customers buy from several providers at once, and what that means for new entrants
  • Why data center proxies still sold well for years, and why they are now going out of style
  • Two sides of ethics in proxies: what customers use the IPs for, and how the IPs are acquired
  • Why IP diversity across subnets and ASNs is harder to keep than raw IP volume

In the full article: Neil’s complete answers, the conditions he sets for residential IP use, his view on SDK regulation, the FBI story from 2018 and his practical tips on IP leasing and ASN choice.

Read the full article on The Web Scraping Club