Merge pull request #63 from Intugle/docs/robots

shiva-intugle · web-flow · commit 1ac5b8995ea7 · 2025-10-06T19:59:10.000+05:30
added robots.txt to prevent scraping of older docs
diff --git a/docsite/static/robots.txt b/docsite/static/robots.txt
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /data-tools/docs/0.1.0/
