Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples
-
Updated
Mar 9, 2026 - HTML
Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples
Generate badges showing your website's AI search readiness score from GEOScore
📊 Open methodology for scoring website readiness for AI search engines — 11 technical checks for GEO optimization
🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)
🔍 A curated list of Generative Engine Optimization (GEO) resources, tools, and guides for AI search engines (ChatGPT, Perplexity, Gemini)
Interactive checklist to assess your website's readiness for AI search engines (ChatGPT, Perplexity, Gemini)
Assess your website’s readiness for AI search engines with a browser-based checklist covering AI crawler access, structured data, and content SEO.
Evaluate website readiness for AI search engines with a clear, open scoring system focused on generative engine optimization and accessibility.
Provide an up-to-date database of AI search engine crawler user-agents with robots.txt examples to optimize site access and indexing.
Add a description, image, and links to the geoscore topic page so that developers can more easily learn about it.
To associate your repository with the geoscore topic, visit your repo's landing page and select "manage topics."