Home

Labs

Nb 2 Html Tests 211 Web Scraper Wordclouds Looking At Data Elly Satellltes Naomi Geo Naomi Nlp Test

Don't Look! I'm changing!

URL Copied

IntroductionMinerScraperFinal Solution (Javascript)

Introduction

BinderBinderBinderOpen Source Love svg3

NPM LicenseActiveGitHub last commit


GitHub starsGitHub watchersGitHub forksGitHub followers


(((info:: I made this data scraper to help somone with a daily responsibility)))

We will need these libraries

Miner

(Works, but html content needs to be scraped seperately, through a same-origin request)

Scraper

(Works but doesnt give us what we want)

Get the page

Find the form and select our options

Save the output for previewing

Unfortunately, this does not work!

Our data is stored as dynamic content that is not delivered to us here.

We will need to use Pupeteer to render the dynamic javascript content.

What a shame...

Final Solution (Javascript)

This needs to be ran in a seperate js file.