Meet your Data where it Lives: Scraping the Web

Sometimes, data is made available to us for analysis in a convenient manner. The CSV file, a connection to a relational database, or the well-documented web API... yes, life can indeed be sweet. Sometimes, though... sometimes, our data do not come to us, and so we must go to our data. Important and useful data frequently is published in the form of tables, lists, etc. on web pages; other times, the information we want is spread across multiple pages (or even multiple different sites), and we must ""scrape"" it off in order to work with it. In this workshop, we will cover several techniques that we can use to automate the process of extracting and cleaning data from web-based sources. We will also cover the basics of how web pages organize and represent data, ""under the hood"" of the web browser. By the end, you'll be well on your way to setting up more automated data ingestion pipelines in the face of less cooperative sources!

Introductory

Free