fix(ci): add git pull --rebase before push in all crawler workflows

Prevents push rejection when multiple crawlers run concurrently
(e.g. manual dispatch of all three at once). Each crawler now rebases
onto the latest remote HEAD before pushing its data commit.

Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>

Author: anshulbasia27

.github/workflows/crawl.yml

@@ -52,6 +52,7 @@ jobs:
           if git diff --staged --quiet; then
             echo "No changes detected — skipping commit"
           else
+            git pull --rebase origin master
             git commit -m "chore(data): daily AI stack crawl $(date -u '+%Y-%m-%d')"
             git push
           fi

.github/workflows/fetch-automations.yml

@@ -48,6 +48,7 @@ jobs:
           if git diff --staged --quiet; then
             echo "No changes — skipping commit"
           else
+            git pull --rebase origin master
             git commit -m "chore(data): daily automation workflows update $(date -u '+%Y-%m-%d')"
             git push
           fi

.github/workflows/fetch-mcp.yml

@@ -50,6 +50,7 @@ jobs:
           if git diff --staged --quiet; then
             echo "No changes — skipping commit"
           else
+            git pull --rebase origin master
             git commit -m "chore(data): daily MCP server directory update $(date -u '+%Y-%m-%d')"
             git push
           fi