Summary of an article published on The Web Scraping Club on 2023-02-20 (free to read). Read the full article
The Web Scraping Club has been running for a while, and finding an old post by topic gets harder with every issue. If you are looking for a specific tutorial, an anti-bot write-up or an interview, scrolling the feed is a poor way to do it.
This page is the archive of everything I have published so far, split into six sections: web scraping tutorials and tools, anti-bot technology and bypass articles, interviews with key people in the industry, news recaps, THE LAB, and Hands On. Each section links to its own index and shows the latest post. Examples include a THE LAB issue on managing a fleet of scrapers with Scrapeops, one on scraping Cloudflare protected websites, an interview with Veritas on deobfuscation, and a Hands On test of the Bright Data Web Unblocker.
What’s inside
- THE LAB is the hands-on series, with its own archive and a separate one for anti-bot topics.
- The Hands On series is where I try out web scraping products and review them, so you can judge them before spending money and time.
- The interviews section covers people working in the scraping industry, with Veritas and anti-obfuscation as one example.
- The news section is a monthly recap of what happened in the web scraping industry.
In the full article: Links to each topic index and to every individual post, from the tutorials and the anti-bot articles to the interviews, the news recaps, THE LAB issues and the Hands On reviews.