Skip to content

+DS vLE: Web Scraping


Chris Bail

In this seminar, we will learn how to collect data using Application Programming Interfaces. This lecture will introduce key concepts such as credentialing and rate limiting, and provide an example of how to collect data from Twitter. The seminar will discuss the strengths and weaknesses of using APIs for data scraping, and briefly discuss alternative web-scraping techniques as well. This class will assume basic working knowledge of R. This session is part of the Duke+DataScience (+DS) program virtual learning experiences (vLEs). To learn more, please visit