v0.9.0

Changelog

• d2aec14 Add tag name and more traversal methods (#73)
• 63e8d0d Bump version in install script
• 175cb07 Change cache backend from sqlite to bbolt
• 26a033b Generate random user agent when non is provided (#76)
• 7b5da87 Update README.md
• 54a8ea0 Update js.go (#71)
• 653be45 fix user agent formatting

v0.8.1

Changelog

• 92baa16 Improve cookie support for browser mode

v0.8.0

Changelog

• 6cc19d5 Browser rendering
• 3dc39e9 Fix typo in example config
• e449cbe Improve file watcher
• ba009a9 Remove the setup function while we can
• e2e0ed8 Use the cookie store from local browser

v0.7.2

Changelog

• 76b3fa8 Create curl installer
• c460e48 Fix race condition when writing JSON output
• f4a69b7 Increase url queue size
• c796f41 Make urls more fault tolerant
• 0b4c723 Mark non 2XX status code as errors
• 80e24f0 Respect multiple urls in domain- and urlfilter

v0.7.1

Changelog

• faefb42 Add 403 Forbidden as retryable HTTP status code

v0.7.0

BREAKING CHANGE

• The rate configuration option changed from requests per second to request per minute.

Changelog

• 0d6494d Add retry module and change rate to requests per minute (#37)
• 8ad9f9f Add single proxy support (#30)
• 60139e7 Fix addition of invalid proxy url

v0.6.1

Changelog

• 8b7425e Add version command (#29)

v0.6.0

Changelog

• cbdbbd2 Add custom request header (#18)
• 807b9a1 Add missing test in TestJSLibHTTPDownload (#22)
• 13322ed Gracefully handle NaN and Inf values (#21)
• 8c68e0e Make output file and format configurable (#24)
• 0f9e334 Support file imports for .txt and .json (#25)

v0.5.0

Changelog

• 94da929 Add file download functionality
• beadfd1 Add multiple starting URLs
• 47d58e6 Add support for CLI float parsing
• 190056e Move docs to flyscrape.com (#11)
• 6aa52bd Support passing config options as CLI arguments (#15)
• 3e01902 Update documentation

v0.4.1

Changelog

• eae1042 Enable cgo compilation in goreleaser (#7)