[BUG] The model returned the following errors: invalid beta flag

[ZSamuels28]

Problem (one or two sentences)

When attempting to use Claude 3 Haiku (anthropic.claude-3-haiku-20240307-v1:0) through AWS Bedrock with Roo Code, requests fail with:

Provider ended the request: Unknown Error: The model returned the following errors: invalid beta flag

I believe the issue is the Claude CLI adds the token-efficient-tools beta header by default (since it's optimized for Claude 3.7 Sonnet, which supports this feature). However, Claude 3 Haiku does not support this beta feature, causing Bedrock to reject the request before it reaches the model.

Reference: https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-anthropic-claude-messages-request-response.html

Context (who is affected and when)

All users running Haiku 3

Reproduction steps

1. On Roo Code (Using Ubuntu) select Haiku 3 as the model with Amazon Bedrock
2. Test the model
3. Error

Expected result

Haiku 3 works

Actual result

Haiku 3 throws an error

Variations tried (optional)

No response

App Version

3.50.4

API Provider (optional)

Amazon Bedrock

Model Used (optional)

Claude 3 Haiku

Roo Code Task Links (optional)

No response

Relevant logs or errors (optional)

[roomote]

I've analyzed this issue and here's my proposed implementation plan:

Root Cause: In src/api/providers/bedrock.ts (line 441), the fine-grained-tool-streaming-2025-05-14 beta header is added for ALL Claude models via baseModelId.includes("claude"). However, older Claude 3 models (Claude 3 Haiku, Claude 3 Opus, Claude 3 Sonnet, and the original Claude 3.5 Sonnet 20240620) do not support this beta flag on Bedrock, causing Bedrock to reject the request with "invalid beta flag".

Proposed Fix:

1. In src/api/providers/bedrock.ts, change the condition at line 441 from a broad baseModelId.includes("claude") check to an exclusion list for older Claude 3 models that do not support the fine-grained-tool-streaming beta. The excluded models would be:

   • anthropic.claude-3-haiku-20240307-v1:0
   • anthropic.claude-3-opus-20240229-v1:0
   • anthropic.claude-3-sonnet-20240229-v1:0
   • anthropic.claude-3-5-sonnet-20240620-v1:0

2. Define a constant array (e.g., BEDROCK_FINE_GRAINED_STREAMING_UNSUPPORTED_IDS) listing these older model IDs, and only add the beta when the model is a Claude model AND is not in the unsupported list.

3. Update existing tests in src/api/providers/__tests__/bedrock.spec.ts and bedrock-native-tools.spec.ts to verify the beta is NOT sent for Claude 3 Haiku and other unsupported models, and IS still sent for supported models (Claude 3.5 Sonnet 20241022+, Claude 3.7, Claude 4+).

This approach ensures older Claude models work correctly on Bedrock while preserving the fine-grained tool streaming feature for newer models that support it.

Please mention @roomote in a comment saying that you approve this plan, and I'll proceed with the implementation.

[ZSamuels28]

@roomote approved

[roomote]

I've seen your approval and will start implementing the fix now. I'll open a PR to share progress shortly.

[roomote]

Opened PR #11720 with my attempt at addressing this. The fix adds an exclusion list for older Claude 3 models that don't support the fine-grained-tool-streaming beta flag, so the beta is only sent to models that support it. Feedback welcome!