Summary of an article published on The Web Scraping Club on 2024-08-29 (free to read). Read the full article
September starts and The Web Scraping Club is back on a weekly schedule. The Lab articles come almost every Thursday and free articles every Sunday. On Tuesdays we host contributions from external companies that want to share their expertise in a specific field. After ten days in Crete, I also thought about how to make the newsletter feel more like a club.
During July and August I interviewed key people in the scraping industry, on both the scraping and the anti-bot sides. The first two Scraping Insights videos are online, with Nick Rieniets, CTO of Kasada, and Antoine Vastel, VP of Research at DataDome. On the club side, I built a Notion template for my writing pipeline, opened a form for topic suggestions, added a rating form to each post and a reason-for-leaving form to the unsubscribe email.
What’s inside
- The Kasada interview is a frank talk on how bot building and detection keep changing and which challenges both sides still have to tackle.
- Antoine Vastel runs a device and browser info blog that many people in the industry have already read.
- The topic form lets you tell me whether you want to write the post yourself.
- The rating form takes 30 seconds and is anonymous, and the unsubscribe survey goes to both free and paid subscribers. More videos will follow on the YouTube channel, made possible by paid subscribers.
In the full article: Links to both interview videos, the topic and rating forms and the YouTube channel, a screenshot of my Notion template and the OxyCon 2024 agenda recap.