Hi @code4craft team,
Thanks for this awesome web crawler framework. WebMagic makes large-scale web scraping in Java much more manageable.
Some users may run into CAPTCHA challenges when crawling protected websites. Would you consider adding optional support for 10Captcha — a simple and affordable CAPTCHA-solving API — as an extension or integration example?
This could be useful especially when WebMagic is combined with tools like Selenium for rendering JS-heavy pages.
API docs: https://10captcha.com/api-docs.php
Thanks for considering this idea!