You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
SQL UPDATE Support for DataFusion Integration #2205
Implement SQL UPDATE functionality for iceberg-datafusion integration, enabling row-level updates with WHERE clause filtering. This completes the essential DML operations alongside INSERT and the upcoming MERGE INTO support #2201.
UPDATE orders
SET status = 'shipped', shipped_date = current_date()
WHERE status = 'pending' AND payment_confirmed = true;
Overall Architecture
UPDATE table SET col1 = val1, col2 = val2 WHERE condition
↓
TableProvider::update() [NEW]
↓
IcebergTableScan (with WHERE filters)
↓
[Optional if partitioned: Project partition + Repartition + Sort for partitioned tables]
↓
IcebergUpdateWriteExec [NEW] - Apply assignments, write new files, track deleted
files
↓
CoalescePartitionsExec (reuse existing)
↓
IcebergUpdateCommitExec [NEW] - Commit via RowDelta transaction
↓
RecordBatch(count: UInt64)
Strategy: Copy-on-Write (COW)
Scan table with WHERE filters to find matching rows
Apply UPDATE assignments (evaluate expressions)
Write modified rows to new data files
Mark original files as deleted
Commit atomically with RowDelta (add new files + remove old files)
The following tasks are already completed on the PoC branch with 6 commits. Will raise formal PRs one after another as the fork repo doesn't support stacking PRs.
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Activity
blackmwk commentedon Mar 5, 2026
Thanks @wirybeaver for creating this issue. Do datafusion support dml syntax such as update, delete now?
blackmwk commentedon Mar 5, 2026
Seems datafusion still not supporing these statements: https://datafusion.apache.org/user-guide/sql/dml.html
wirybeaver commentedon Mar 5, 2026
@blackmwk The UPDATE is supported in Datafusion. https://github.com/apache/datafusion/blob/1f0232c995111e2a9b8d58228ca604c804d0a879/datafusion/sql/src/statement.rs#L1063
[-]SQL UPDATE Support for Iceberg-DataFusion[/-][+]SQL UPDATE Support for DataFusion Integration[/+]blackmwk commentedon Mar 11, 2026
Thanks @wirybeaver for raising this. I think it should support both mor and cow?
wirybeaver commentedon Mar 22, 2026
@blackmwk Check my comment under the #2269 Prefer implementing cow and mor in a incremental manner
github-actions commentedon Sep 19, 2026
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
wirybeaver commentedon Sep 19, 2026
waiting for #2620