Skip to content

Jcode cannot be stopped while retrying after rate limit is hit #826

Description

@renggap

Description

When using a model that has reached its rate limit, JCode continuously retries the request indefinitely. During this state, the application becomes effectively impossible to stop, interruption is ignored, and the retry loop continues.

Steps to Reproduce

  1. Configure a model/API with a low rate limit.
  2. Send requests until the rate limit is reached.
  3. Observe the retry behavior.
  4. Attempt to stop the current operation.

Expected Behavior

  • Retry logic should either:
    • stop after a configurable number of attempts, or
    • wait according to the provider's Retry-After header.
  • Instructing Stop should immediately cancel all pending retries and terminate the request.

Actual Behavior

  • The application keeps retrying indefinitely after receiving the rate limit error.
  • The Stop instruction has no effect while retries are occurring.
  • The only way to recover is to forcibly terminate the application/process.

Additional Information

I've attached a screenshot showing the retry loop and the inability to stop the process.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions