What it is

RetroWEB is a forwarding proxy designed to bridge the gap between old web browsers and modern websites. It fetches HTTPS pages using a modern connection, processes the content by removing scripts and styling, rewrites links, and returns a simplified page over ordinary HTTP that legacy browsers can understand.

How it works

RetroWEB 2.0 functions as a public HTTP forwarding proxy, sitting between the old browser and the modern website. It terminates the modern HTTPS connection and translates the result into old-fashioned HTTP, as it deliberately does not support the HTTPS CONNECT method. This allows the old browser to maintain a connection it can handle.

The proxy performs further processing before sending the page back, attempting to find the main content and converting useful parts of modern layouts into formats like HTML 2.0, HTML 3.2, or basic HTML 4.01, depending on the selected browser profile. It also rewrites simple forms, allowing basic GET and URL-encoded POST forms, while disabling password fields and file uploads.

TWSC experience

Not yet tested by TWSC.

Known limitations

Old links from the first version may no longer work.

Sources


The Web Scraping Wiki is compiled from the tests and research published on The Web Scraping Club, the newsletter for web scraping professionals. Subscribe to get the next article in your inbox.