Skip to content

README.md

Latest commit

 

History

History
24 lines (16 loc) · 618 Bytes

README.md

File metadata and controls

24 lines (16 loc) · 618 Bytes

Automated-Web-Data-Scraper

This is an Automation based project made with python ans its library Scrapy. Its Basically Scrap data from website and generates a csv or json file forrmat.

Create a virtual environment

  • pip install pipenv
  • (Go to the directory where you want to create project
  • virtualenv .
  • .\scripts\activate

Install Libraries

  1. Scrapy
  • pip install scrapy

Command to create csv file

First go to directory here my main directory is careervira

  1. Create csv file -> scrapy crawl Careervira -o items.csv

  2. Create json file -> scrapy crawl Careervira -o items.csv