Skip to content

[NOT READY FOR REVIEW] Add DataFusion 55.0.0 release blog post - #203

Draft
alamb wants to merge 1 commit into
apache:mainfrom
alamb:datafusion-55-blog
Draft

[NOT READY FOR REVIEW] Add DataFusion 55.0.0 release blog post#203
alamb wants to merge 1 commit into
apache:mainfrom
alamb:datafusion-55-blog

Conversation

@alamb

@alamb alamb commented Aug 16, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

Draft blog post announcing the DataFusion 55.0.0 release, following the model of the 54.0.0 post.

This is an early draft and is NOT ready for review yet. Known TODOs:

  • Generate the ClickBench performance-over-time chart for 55.0.0 (content/images/datafusion-55.0.0/performance_over_time_clickbench.png)
  • Confirm the final release/publish date (currently 2026-08-16) and rename the file to match
  • Verify feature descriptions, credits, and reviewer attributions with the contributors involved
  • Double-check which late-merged PRs actually made the branch-55 cut

Content highlights (drawn from the 55.0.0 release ticket feature list):

  • Range partitioning (highlighted as a key new feature per discussion on the blog ticket)
  • MERGE INTO planner + TableProvider hook
  • Per-partition TopK for window functions (ROW_NUMBER/RANK)
  • Sort pushdown phase 4: runtime row-group pruning for TopK
  • Parquet virtual columns (file_row_index, input_file_name)
  • unnest_outer, pluggable spill backends, UDF strictness metadata
  • Extensibility APIs for distributed engines (FFI_QueryPlanner, dynamic filter APIs, proto hooks)
  • Aggregation, function, planner, and scan performance improvements

🤖 Generated with Claude Code

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
partitions based on ordered split points ([#22395], design discussion
[#21992]). Range partitioning preserves ordering across partitions, which is a
natural fit for pre-sorted data and for distributed engines that shuffle by
range.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe a quick example or link to documented example to show how split points are used 👍

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can of course make this change, just throwing idea out there first

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gene-bordegaray -- I am very behind on this post (I have been working on the ALP blog post with @sdf-jkl apache/parquet-site#195)

I now have some time and will likely focus on this over the next day or two

I also added you as a collaborator on my fork, so you should now be able to push directly to this branch -- please feel free to do so

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sweet I will take time this weekend to help with edits here and in general 🙇

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants