Scrap The Web Collection.
This repo contains to scrap the following kind of websites :
- Do you want to learn Scrapy? [ScrapScrapy] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapScrapy) is gonna be your first scrapy project in that case.
- If you want to scrap a simple website without any javascript or AJAX calls,you can have a look at [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/SimpleScrapy) project. This uses CrawlSpider.
- If you want to use selenium with scrapy, have a look at [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapyWithSelenium) project.
- You can refer [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapyWithDjango/Forestessentialsindia) project, if you want to save to Django DB as you scrap.
