Web Scraping with Python for the Humanities

N8 CIR

Eamonn Bell from the University of Durham will be hosting a course on web scraping as a data collection technique for researchers.

Apply for a place at this event. If you are offered a place for the first session, you are automatically enrolled in the second session. Both are required for the full syllabus of this course. Session 1: Tuesday 17th January 2023Duration: 3 hours (online)Eligibility: postgraduate researchers (and above), enrolled at/working in N8 institutionsPre-requisites: a basic familiarity with Python and interacting with computers (Windows, mac OS, or GNU/Linux) using the command line; access to a Jupyter Notebook environment with the capacity to install modules from PyPI (please contact your host institution if you do not have this already).This workshop will introduce participants to intermediate topics in the use of web scraping as a data collection technique for researchers in the humanities. Web scraping is a technique for using computers to systematically identify and retrieve information hosted on web servers, which can be a valuable source of research data for humanities researchers given the diversity of historically, culturally, and sociologically significant of material available online. Topics covered will include:<ul><li>An introduction to web technologies</li><li>Ethical, legal, and social issues of web scraping</li><li>(Politely) requesting remote resources using Python</li><li>Parsing HTML documents with BeautifulSoup (`bs4`)</li><li>Saving the results of web scraping for later analysis</li></ul>Session 2: Tuesday 24th January 2023Duration: 3 hours (online)Eligibility: postgraduate researchers (and above), enrolled at/working in N8 institutions Pre-requisites: a basic familiarity with Python and interacting with computers (Windows, mac OS, or GNU/Linux) using the command line; an understanding of the principles of web scraping (see Day 1); access to a Jupyter Notebook environment with the capacity to install modules from PyPI (please contact your host institution if you do not have this already).Topics covered will include:<ul><li>Intermediate topics in parsing HTML documents with BeautifulSoup (`bs4`)</li><li>Programmatically expanding the scope of scraping by extracting URLs from HTML</li><li>Scheduling and managing web scraping tasks</li><li>Approaches to scraping dynamic web properties</li><li>Approaches to dealing with archived web properties</li></ul>M﻿ore resources can be found at https://www.eamonnbell.com/

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Web Scraping with Python for the Humanities

More events from N8 CIR

Discover more events from N8 CIR, from Science & Tech to other experiences you might love.

Web Scraping with Python for the Humanities

More events from N8 CIR

Discover more events from N8 CIR, from Science & Tech to other experiences you might love.

More Science & Tech events

Browse more Science & Tech events with different dates, prices, and formats to find your next great experience.