Sign In

Communications of the ACM

ACM Opinion

Web Scraping

View as: Print Mobile App Share:
Lecturer Diarmuid McDonnell.

Credit Diarmuid McDonnell.

Diarmuid McDonnell is a lecturer in Social Sciences at the University of the West of Scotland.

In this interview, Diarmuid McDonell talks about webscraping, a key computational tool for data collection. McDonell discusses what social scientists or data scientists must evaluate before starting on a web scraping project, what they should learn and watch out for, and the challenges they may encounter.

The discussion then focuses on the use of Python libraries and frameworks that aid webscraping as well as the processing of the gathered data which centers around collapsing the data into aggregate measures.

From Software Engineering Radio
Listen to Full Podcast


No entries found