Web scraping

SICSS, 2022

Christopher Barrie

Introduction

• Why scrape pages?
  • Often, because there’s no API…
  • Or the API doesn’t give us what we want
  • Or we just want to grab a small amount of info…

Early origins…

Examples

• Data and code https://osf.io/hwuxf/?view_only=3fa7499661df487689031e11b8ea20b4

Examples

Group work

1. Come up with a question answerable using scraped data
2. Detail the data you would collect