Summary of an article published on The Web Scraping Club on 2023-12-31 (free to read). Read the full article
This is the last post of 2023, the point where we look back at the year and plan the next one. I started The Web Scraping Club because after 10+ years in the industry I felt web scraping experts needed a place to openly share tools, techniques and experiences, especially now that scraping keeps getting harder. The community grew a lot this year, on the newsletter and on our Discord server.
I go through the numbers and the three most-read posts of the year. Two of them are about AI and LLMs, the third is a Cloudflare bypass piece from The Lab. Then I lay out the 2024 plan. The goal is to move the club away from a one-man-band show, with more guest posts from key people in the industry, a monthly legal column, and a change in how often The Lab comes out. I also explain what stays free, what is paywalled and why, and how to get a free plan.
What’s inside
- Which three posts were the most read in 2023, and why the podium reflects the year of AI
- How the first ChatGPT scraper test went, and why AI-powered scraping tools are expected to keep improving in 2024
- Who writes the new monthly legal column, and what guest post slot I hope to fill every Tuesday
- The planned weekly schedule: The Lab on Thursdays, free posts and the Web Scraping from 0 to Hero course on Sundays
In the full article: Subscriber growth chart, links to the three most-read posts, the full 2024 publishing calendar, the paywall rationale, and the year-end offers for annual and group plans.