Summary of an article published on The Web Scraping Club on 2022-09-18 (free to read). Read the full article

This is the first interview in our series, and I opened it with Neha Setia, developer advocate at Zyte. Zyte started in 2010 as Scrapinghub, a web scraping services company, and today it sits behind a stack of tools many of us already use or at least know by name, Scrapy first of all. For anyone working in this industry, hearing how a vendor sees demand, anti-bot software and legal risk is useful context.

I asked Neha about how Zyte evolved from a services shop, which services it sells, and what customers ask for most. We covered the effect of Covid-19 on data requests, how anti-bot systems and fingerprinting have changed, and where machine learning is already used in scraping. We also talked about the legal gray area and the rules Zyte follows, what it takes to maintain Scrapy, how much open source helps a company, and what to expect from Extract Summit 2022.

What’s inside

  • Which product lines Zyte offers today, from Scrapy to Scrapy Cloud, and how its Automatic Extraction API handles different page types
  • Which kind of data customers request most, and how Covid-19 changed the volume of those requests
  • Why digital fingerprinting makes anti-bot systems harder to beat than the simple captchas of the past
  • Her view on whether open source alone makes a company successful, and how Zyte gives developers time to maintain it

In the full article: Neha’s complete answers to each question, including the figures she quotes on customers and request volumes, the legal best practices she lists, and the themes and talks planned for Extract Summit.

Read the full article on The Web Scraping Club