bedrock: Fix Claude 4 output token bug (#31599)

Shardul Vaidya created 6 months ago

Release Notes:

- Fixed an issue preventing the use of Claude 4 Thinking models with Bedrock

Change summary

crates/bedrock/src/models.rs | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)

Detailed changes

crates/bedrock/src/models.rs

@@ -253,7 +253,9 @@ impl Model {
             | Self::Claude3_5Haiku
             | Self::Claude3_7Sonnet
             | Self::ClaudeSonnet4
-            | Self::ClaudeOpus4 => 200_000,
+            | Self::ClaudeOpus4
+            | Self::ClaudeSonnet4Thinking
+            | Self::ClaudeOpus4Thinking => 200_000,
             Self::AmazonNovaPremier => 1_000_000,
             Self::PalmyraWriterX5 => 1_000_000,
             Self::PalmyraWriterX4 => 128_000,