Topic

Paywalls, Beautiful Soup, and reading what was sent to you

By: Phil Robare

Date: Nov. 9, 2023, 6 p.m.

The paywall at Wired.com, TheAtlantic.com and other websites implement a paywall with javascript. The source page that is sent has the entire article. This talk is about the use of the BeautifulSoup package (which manipulates HTML documents) to read what the web site sends.