digikala-crawler

🕷️ A crawler to collect comments and product information on digikala.com

Installation

Install Python and pip. Then:

$ git clone https://github.com/rajabzz/digikala-crawler.git
$ cd digikala-crawler
$ pip install -r requirements.txt

Running The Crawler

The following command runs the comment spider and saves the output in the results.jl file.

$ scrapy crawl comment -o results.jl 

License

This project is licensed under the MIT License - see the LICENSE file for details