Skip to content

Latest commit

 

History

History
10 lines (7 loc) · 335 Bytes

File metadata and controls

10 lines (7 loc) · 335 Bytes

layoff_scraper

Aggregate and process layoff data from website into a structured dataset

To run from command line run pipenv install/pipenv shell.

call scraper.py script with args a) output text name b) link to scrape from layoff_list site

todo: add scrapy-selenium middleware so numerous scrape tasks can be run asynchronously