Skip to content

Reduce DataFusion dependency to minimally required crates - #153

Open
AdamGS wants to merge 1 commit into
datafusion-contrib:mainfrom
AdamGS:adamg/reduce-build-dependencies
Open

AdamGS wants to merge 1 commit into
datafusion-contrib:mainfrom
AdamGS:adamg/reduce-build-dependencies

Conversation

@AdamGS

@AdamGS AdamGS commented Nov 10, 2026

Copy link
Copy Markdown

The crate actually only depends on datafusion-common and datafusion-expr, this change changes the non-test dependencies to reflect that. It should help users that have more complex dependency trees, where having datafusion (with feature unification) as a dependency here will probably cause a bottleneck during builds.

Running cargo clean && cargo build on main and with this branch shows the following improvement:

release build (seconds) dev build (seconds) Compilation units
Before (datafusion) 206 60 270
After (datafusion-common + datafusion-expr) 60 19 165
Change −146 (−71%, ~3.4× faster) −41 (−68%, ~3.2× faster) −105 (−39%)

@AdamGS AdamGS changed the title Reduce DataFusion dependency to minimal crates Reduce DataFusion dependency to minimally required crates Nov 10, 2026
@codecov-commenter

codecov-commenter commented Nov 10, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 96.66667% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 93.58%. Comparing base (aea0da0) to head (e163a17).

Files with missing lines Patch % Lines
src/common_macros.rs 50.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #153      +/-   ##
==========================================
- Coverage   93.79%   93.58%   -0.22%     
==========================================
  Files          18       18              
  Lines        1950     1917      -33     
  Branches     1950     1917      -33     
==========================================
- Hits         1829     1794      -35     
  Misses         66       66              
- Partials       55       57       +2     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants