You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Track dictionary IDs when decoding IPC schema #844
In #738 we added and tested support for decoding an IPC schema that contains dictionary-encoded fields; however, the decoder does not yet provide a way to export the dictionary IDs with the schema. We probably need something like:
I was thinking that ArrowIpcSchemaDictionaries could be essentially a Vec<(const struct ArrowSchema*, int64_t)> where the pointers correspond to the dictionary pointers in the decoded schema. This allows the setter to locate the dictionary IDs when looping over the schema with the downside the pointers are invalidated if anybody decides to ArrowSchemaDeepCopy(). I'm not also not sure there's a better solution in the presence of potentially nested dictionaries.
Activity
feat: Add Dictionary schema read support in IPC reader (#738)
feat: Add ArrowIpcDictionaryMapping to track dictionary identifiers w…