CrawlCore

All

2 repositories

scp-protocol
Public
A collection-based format for serving clean, structured web content to AI training systems and search engines through pre-generated collections.
web-standards specification internet-draft
web-standards specification internet-draft data-format ai-training ai-crawler web-protocol ai-crawling ietf-draft
Python
•
Creative Commons Zero v1.0 Universal
•0•4•0•0•Updated Jan 4, 2026Jan 4, 2026
qcrawl
Public
qcrawl - fast async web crawling & scraping framework for Python.
python crawler framework
python crawler framework async scraping crawling web-scraping asyncio web-data-extraction web-scraping-python
Python
•
MIT License
•5•109•0•0•Updated Dec 7, 2025Dec 7, 2025

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.