README.md

Crawlers can be executed independent of the GIG server. Crawlers communicate with the GIG server only through APIs. However crawlers may depend on several utility classes and models

Configure Server API URL at conf/config.json

• PDF Crawler Documentation
• Web Crawler Documentation
• Wiki API Crawler Documentation