How to SCRAPE DYNAMIC websites with Selenium

Опубликовано: 12 Февраль 2020
на канале: John Watson Rooney
171,378
3.7k

How I use Selenium and Python to automate a browser to scrape data from dynamic websites. These sites load the content through JS or similar meaning we cannot use requests to get the html information. This is a way to get to that info.

Scraper API: https://www.scrapingbee.com/?fpr=jhnwr
Proxies I use: https://proxyscrape.com/?ref=jhnwr
Hosting: Digital Ocean (Affiliate Link) - https://m.do.co/c/c7c90f161ff6
Gear Used: https://jhnwr.com/gear/ (NEW)
Patreon:   / johnwatsonrooney   (NEW)