Skip to content

Add proper token update to the db, in case generating a inference response fails #316

@jorgeantonio21

Description

@jorgeantonio21

Right now, we overestimate the number of tokens to be processed in the atoma state db, but if a response fails to be generated, we don't re-update the database to set it to 0.

Metadata

Metadata

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions