Skip to content

Add support for AWS Glue's implementation of Iceberg REST Catalog API #3

Description

@mdub

We recently added basic support for the Iceberg REST Catalog API (commit 000ff95), but it won't work with AWS Glue REST Catalog endpoints like:

https://glue.us-west-2.amazonaws.com/iceberg/v1/catalogs/979779072649

AWS Glue REST endpoints require AWS Signature Version 4 (SigV4) for authentication.

Activity

  1. added theissue type on Nov 26, 2025
  2. mdub commented on Nov 26, 2025

    @mdub
    CollaboratorAuthor

    Unfortunately, iceberg-catalog-rest 0.7.0 currently lacks SigV4 support. There's an open issue:

  3. mdub commented on Oct 26, 2026

    @mdub
    CollaboratorAuthor

    SigV4 support for the REST catalog is under way upstream in iceberg-rust, but none of it has been released yet. 0.10.1 (1 August) is still the latest release. The tracking issue is still apache/iceberg-rust#1236, and the work has been split into four PRs:

    • #2838 (merged 13 Aug): AuthManager/AuthSession traits for pluggable REST catalog auth.
    • #3082 (merged 9 Oct): SigV4Signer, behind a new sigv4 feature.
    • #3092 (open, not yet reviewed): SigV4AuthManager, which an application plugs in with with_auth_manager.
    • #2660 (draft, depends on #3092): turning SigV4 on from catalog properties (rest.auth.type=sigv4).

    Once #3092 is in a release, bergr should be able to pass a SigV4AuthManager to the REST catalog and talk to Glue's REST endpoint, without needing #2660. Until then, the alternative is a git dependency on iceberg-rust main plus our own AuthManager wrapping SigV4Signer. I haven't checked whether the API on main makes that practical.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions