Skip to content

Instruct llms to always read docs instead of using pre-trained knowledge#938

Open
heypoom wants to merge 5 commits intomasterfrom
emb-1292-instruct-llms-to-read-from-docs-and-use-a-cleaner-raw-url
Open

Instruct llms to always read docs instead of using pre-trained knowledge#938
heypoom wants to merge 5 commits intomasterfrom
emb-1292-instruct-llms-to-read-from-docs-and-use-a-cleaner-raw-url

Conversation

@heypoom
Copy link
Member

@heypoom heypoom commented Feb 5, 2026

Closes EMB-1292

Instruct LLMs to always read from docs instead of relying on the pre-trained knowledge that it knew. Claude Opus tends to do that because it thinks it has the up-to-date knowledge.

PS. I tried to use the cleaner github.com/raw URL, but it is even worse because the Web Fetch tool takes extra tool call to follow redirects and doesn't do that automatically 🤦🏻

Demo

Model: Claude Haiku (cheapest)

CleanShot 2569-02-05 at 15 22 04@2x

Model: Claude Opus (best)

CleanShot 2569-02-05 at 15 20 26@2x

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Feb 5, 2026

Deploying docs-metabase-github-io with  Cloudflare Pages  Cloudflare Pages

Latest commit: 74a140c
Status: ✅  Deploy successful!
Preview URL: https://fe522bc8.docs-metabase-github-io.pages.dev
Branch Preview URL: https://emb-1292-instruct-llms-to-re.docs-metabase-github-io.pages.dev

View logs

heypoom and others added 2 commits February 5, 2026 20:47
Co-authored-by: Jeff Bruemmer <jeff.bruemmer@gmail.com>
Co-authored-by: Jeff Bruemmer <jeff.bruemmer@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants