You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Support refreshing vended storage credentials for REST catalog tables #2931
Is your feature request related to a problem or challenge?
REST catalogs can vend short-lived storage credentials for accessing table data. Iceberg Java supports refreshing these credentials through cloud-specific refresh endpoints before they expire.
iceberg-rust does not currently refresh per-prefix credentials. Consequently, long-running reads, writes, and maintenance operations can fail once the initial S3 or GCS credentials expire.
Refresh support must preserve per-prefix credential isolation, table-scoped catalog authentication, and support tables referencing multiple storage prefixes or clouds.
This issue tracks the work required across the core storage API, OpenDAL backends, and REST catalog. The initial reference implementation was developed and reviewed in #2932.
Describe the solution you'd like
Add refreshable storage credential support across the REST catalog, FileIO, and storage backends:
Introduce a backend-independent credential-provider interface for FileIO
Use the standard AWS and GCS refresh endpoint properties returned by REST catalogs
Cache credentials per cloud and select the longest matching storage prefix
Activity