Add parquet-format 2.14.0 features to the support features page - #202
Conversation
alamb
changed the title
Co-authored-by: Fokko Driesprong <fokko@apache.org>
Co-authored-by: Kosta Tarasov <33369833+sdf-jkl@users.noreply.github.com>
Co-authored-by: Kosta Tarasov <33369833+sdf-jkl@users.noreply.github.com>
Co-authored-by: Kosta Tarasov <33369833+sdf-jkl@users.noreply.github.com>
| status: read | ||
| encoding-byte-stream-split: | ||
| status: read | ||
| encoding-alp: |
There was a problem hiding this comment.
are the entries needed for rending? No objection to adding them, just curious
There was a problem hiding this comment.
yes, when they weren't in there somehow the "2023 features" / "2024 features" table got messed up (didn't render)
There was a problem hiding this comment.
Actually, I double checked, and I think a missing entry renders as a blank "no data" cell, and status: none renders as ❌.
emkornfield
left a comment
emkornfield
left a comment
There was a problem hiding this comment.
we technically added that unrecognized logical type to physical type mappings should be ignored, not sure if want to include this as well?
prtkgaur
left a comment
prtkgaur
left a comment
There was a problem hiding this comment.
Thanks for adding the images.
Makes it easy to visualize/understand the changes
There was a problem hiding this comment.
missing release_date, not sure if that's intentional
There was a problem hiding this comment.
it wasn't -- good catch. I have fixed in 976e67a
I am not sure that is really a feature per se (though I suppose one could argue that we could test readers to see if they ignored unknown logical types 🤔 ) I think what I will do instead is to remove some of the other extraneous detail (like everything other than the main ALP commit) to try and avoid this becoming a github changelog |
|
Thank you very much @prtkgaur @sdf-jkl @divjotarora @Fokko and @emkornfield |
6 participants
Note: This PR will stay in draft and must not be merged until the 2.14.0 RC1 release vote passes.Rationale
Keep the page up to date
parquet-format 2.14.0 has been released: [VOTE] Release Apache Parquet Format 2.14.0 RC1.
Preview
Rendered preview
Details
This PR adds all the format features included in that release to the Features and Versions page and the Implementation Status matrix:
Replaces #199, which covered only ALP.
Also adds features for the newly release arrow-rs Rust version 60.0.0