Skip to content

Stop asserting token counts for multimodal chat completions #120

Closed

Description

OpenAI Chat Completions does not return token counts by default.
Text-based input and output can be estimated with tiktoken, but we consider estimating multimodal tokens out of scope.

Activity

  1. constantinius commented on Mar 24, 2026

    @constantinius
    Contributor

    The test case was fixed to include the correct streaming option so that we could get the token counts. Additionally a PR in the Python SDK allows us to capture token usage in streaming completions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions