elasticstats-scrapy

A scrapy extension to send crawl stats to elasticsearch index.

how to install

$ pip install elasticstats-scrapy

how to use

In order to use this extension, add following settings in settings.py

• ELASTICSTATS_ENABLED

• ELASTICSEARCH_AUTH

• ELASTICSEARCH_SERVERS

• ELASTICSEARCH_USE_SSL

• ELASTICSEARCH_USERNAME

• ELASTICSEARCH_PASSWORD

• ELASTICSTATS_INDEX

• ELASTICSTATS_TYPE

After updating these settings, add the following line in you settings.py extensions setting like this

EXTENSIONS = {
    'elasticstats.ElasticStatsSender': 900
}

Features

• TODO

  • update readme

• Free software: MIT license