Hi Yihua Huang,
Thank you for building WebMagic — it’s a great tool for web crawling with Java.
I’d like to kindly suggest considering an optional integration or example for CaptchaAI, an API service that helps automatically solve CAPTCHAs during crawling.
It could make WebMagic even more powerful for users dealing with protected websites.
Here’s the API documentation for reference: https://captchaai.com/api-docs.php
Thanks for your time and for maintaining such a helpful project!