Retry error

[openconstruct]

I'm using opencode on an amazon ec2 instance with bedrock inference. I got it all set up and working, but every few seconds I get:
AI_RetryError: Failed after 3 attempts, Last error: undefined: Too many tokens, please wait before trying again.

Seems to be worse with opus than sonnet (4.0 for both)

[thdxr]

can you try again with v0.1.163

[openconstruct]

Still happening with 0.1.165 if the fix is in that version specifically I can downgrade.

It happens on opus almost every other message, on sonnet I can do a little bit before it messes up.

[thdxr]

can you do /share and DM me with the info on X

[jluisrojas]

I'm also struggling to use it with bedrock, claude code appears to handle this more effectively with an exponential backoff for retries

[jluisrojas]

This what I believe claude code does to avoid this:

[thdxr]

what is your rate limit allocated with bedrock? default is low but they will increase it

[jluisrojas]

@thdxr we have limits of 4 request per minute and 200,000 inference tokens per minutes in Bedrock with Sonnet 4

[thdxr]

200K per minute should be fine unless you have multiple people using it. surprised you run into this

[thdxr]

i bumped it to 10 retries in v0.1.183 let me know if that's better

[jluisrojas]

@thdxr yes its better with 10 retries, I haven't encountered any issues all day

[rekram1-node]

[automated] Closing due to 90+ days of inactivity. Feel free to reopen if you still need this!