Scraping dynamic web pages rendered with javascript

How do I scrape dynamic content generated with javascript when the page is loaded in browser?

Sometime with spinner (loading…) icon, which may take few seconds to go away and then load the actual content I am looking to scrape.

To scrape dynamic websites, you’d need to enable the JavaScript option in your scraping agent. It’s enabled by default in newly created scraper using the Chrome extension or you may go to the “Edit” tab in your agent page to enable that.

Also you may need to wait few seconds after the page load, depending on your requirement if takes few seconds to render the dynamic page (or element) you are scraping from the website.

So you can enable the wait after page load option with few seconds; or selector to watch before running the extraction.