Skip to content

Support chat reasoning models with thinking traces#3

Open
yildirimozew wants to merge 1 commit into
eth-lre:mainfrom
yildirimozew:thinking-model-chat-support
Open

Support chat reasoning models with thinking traces#3
yildirimozew wants to merge 1 commit into
eth-lre:mainfrom
yildirimozew:thinking-model-chat-support

Conversation

@yildirimozew
Copy link
Copy Markdown

Adds support for OpenAI-compatible chat reasoning models that emit blocks.

  • Strip ... before parsing/scoring visible answers
  • Avoid passing task stop tokens directly to chat APIs, since they can truncate hidden reasoning before the answer
  • Apply stop tokens after stripping thinking
  • Add --store_traces to optionally save extracted thinking traces

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant