Summary of an article published on The Web Scraping Club on 2023-02-16 (free to read). Read the full article
Social networks hold sensitive personal data, so scraping Facebook, Instagram, Twitter or LinkedIn calls for more caution than scraping a product catalog. Platforms tolerate scraping very little, especially after scandals like Cambridge Analytica. Legal trouble can come from two directions: the platform’s Terms of Service and the privacy laws that cover the people whose data you collect.
I wrote a short introduction to both topics. On the ToS side, I explain why platforms are strict, how API access for selected partners fits in, and what changes when data is reachable without logging in. I use the HiQ vs LinkedIn case to show that even a legitimate scraper can pay a high price in time and money to prove it. On the privacy side, I cover why the laws of every country involved matter, not only your own, and what that means for the data you store and resell. It is a starting point, not legal advice.
What’s inside
- Why public data reachable without a login is treated differently from data behind an account, and the limits of that idea
- What the HiQ vs LinkedIn case says about the right to scrape public information and how long the legal fight took
- Why scraping from one country can still bring foreign privacy laws into play, with the Facebook example involving GDPR
- Why collected personal data should be anonymized and synthesized before it is sold, for example for sentiment analysis
In the full article: Links to the HiQ vs LinkedIn coverage and the embedded Zyte video on the legal side of social media scraping, plus my closing advice on consulting a legal office before starting a project.