Automated-Web-Data-Scraper

This is an Automation based project made with python ans its library Scrapy. Its Basically Scrap data from website and generates a csv or json file forrmat.

Create a virtual environment

• pip install pipenv
• (Go to the directory where you want to create project
• virtualenv .
• .\scripts\activate

Install Libraries

1. Scrapy

• pip install scrapy

Command to create csv file

First go to directory here my main directory is careervira

1. Create csv file -> scrapy crawl Careervira -o items.csv

2. Create json file -> scrapy crawl Careervira -o items.csv