Skip to content

fix: rewrite validator system prompt for clarity and correctness#10

Open
linbo328 wants to merge 1 commit into
VsAthul:mainfrom
linbo328:fix/validator-prompt-grammar
Open

fix: rewrite validator system prompt for clarity and correctness#10
linbo328 wants to merge 1 commit into
VsAthul:mainfrom
linbo328:fix/validator-prompt-grammar

Conversation

@linbo328
Copy link
Copy Markdown

Summary

Fixes #2

The _SYSTEM_PROMPT in nodes/validate_node.py contained several issues:

Problems Fixed

  1. Typo: "rsult" instead of "result"
  2. Contradictory instructions: Multiple conflicting retry rules that confused the validator LLM
  3. Dead code reference: Confidence threshold rule (< 0.95) referenced a value not available in the validation node state
  4. Unprofessional grammar: Broken syntax and run-on sentences in the prompt

Changes Made

  • Removed the dead confidence-threshold rule
  • Removed redundant and contradictory retry instructions
  • Rewrote the system prompt as a single, coherent validation rubric
  • Fixed all grammar and spelling issues
  • Kept the same validation criteria (factual correctness, relevance, detail, no hallucinations)

Testing

  • The prompt now provides clear, non-contradictory instructions to the validator LLM
  • All four original validation criteria are preserved
  • The retry logic remains controlled by the graph structure, not the prompt

This PR was generated with the assistance of Auto Bounty Hunter.

- Fix typo: 'rsult' -> removed (dead confidence rule)
- Remove contradictory and redundant retry instructions
- Remove references to unavailable confidence threshold
- Rewrite prompt as a single coherent rubric
- Fixes VsAthul#2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Issue 1: Validator system prompt is grammatically broken and contradicts itself

1 participant