Skip to content

Comments

chore: force Claude to use just-scrape over built-in web tools#12

Open
VinciGit00 wants to merge 2 commits intomainfrom
chore/force-scrapegraph-web-tools
Open

chore: force Claude to use just-scrape over built-in web tools#12
VinciGit00 wants to merge 2 commits intomainfrom
chore/force-scrapegraph-web-tools

Conversation

@VinciGit00
Copy link
Member

Summary

  • Add instructions to CLAUDE.md that prohibit the use of Claude Code's built-in WebFetch and WebSearch tools
  • Map all web-fetching and search tasks to the corresponding just-scrape CLI commands run via Bash
  • Ensures the AI agent dogfoods the project's own tooling for every URL fetch and web search

Mapping

Task Command
Fetch/read a URL bunx just-scrape markdownify <url> --json
Web search bunx just-scrape search-scraper "<query>" --json
Structured extraction bunx just-scrape smart-scraper <url> -p "<prompt>" --json
Raw HTML bunx just-scrape scrape <url> --json

Test plan

  • Open a new Claude Code session in this repo
  • Ask Claude to fetch a URL or search the web
  • Verify it uses just-scrape via Bash instead of WebFetch/WebSearch

🤖 Generated with Claude Code

Add CLAUDE.md instructions that override WebFetch/WebSearch with
just-scrape CLI commands (markdownify, search-scraper, smart-scraper,
scrape) so the AI agent uses the project's own tooling for all web
fetching and search tasks.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants