Scrapy Tutorial

Install Scrapy

Setting up the project

Creating the Spider

Run this snippet in the your command line/terminal to create a spider called “ucla_scraper”:

Next open the file that was created in the “spiders” folder, it should be called “ucla_scraper.py”

Feel free to copy and paste the following code based off of a datablogger tutorial (https://www.data-blogger.com/2016/08/18/scraping-a-website-with-python-scrapy/)

Execute the Spider!

Run the spider from the command line in the parent directory of the spiders folder as follows:

Done!