Bedrock Frequently Has Server-side Errors

[kevinlu1248]

Likely unrelated to the client but I'm getting this pretty frequently on Anthropic Bedrock.

anthropic.APIStatusError: Error code: 424 - {'message': 'The system encountered an unexpected error during processing. Try your request again.'}

Also, it seems like this replace the other issue from: #418, so that issue should be resolved now.

[costa-paxton]

I'm also coming up against this error though Bedrock. Would it make sense to simply add handling for 424 in BaseClient._should_retry?

[rattrayalex]

Ah, yes, that does sound like a good idea. We'll take a look at that.

[mtliendo]

Is this something we should handle on our own in the meantime? Any guidance?

[rattrayalex]

Hey, sorry for the delay in addressing this. This is really more of a Bedrock API issue – they should probably be returning a 5xx for this – but we'll take another look at merging #583 or equivalent.