Repository navigation

fix: Joom 1.1-2 — production fixes for shuffle read, offsets, timestamps, native memory, task kill and task binaries - #3

Merged

msafonov merged 14 commits into

branch-1.1from

joom/1.1-fix

Oct 5, 2026

Commits on Oct 5, 2026
- fix: release each fetched shuffle block once and stop a killed task between blocks
  
  msafonov
  and
  claude
  committed
  705fc11
- fix: keep 32-bit offsets of repeated and coalesced nested columns from overflowing
  
  msafonov
  and
  claude
  committed
  dfa6439
- fix: compare timestamps whose native producers label their time zone differently
  
  msafonov
  and
  claude
  committed
  c9574d2
- fix: let a native sort's spill merge record what it needs past the sorter's memory
  
  msafonov
  and
  claude
  committed
  29b0bb0
- fix: record what a fully ordered final aggregate holds instead of failing
  
  msafonov
  and
  claude
  committed
  c6178ee
- fix: price array grouping keys and dispatched key expressions in the cost-based engine choice
  
  msafonov
  and
  claude
  committed
  3dbd273
- fix: stop a killed task's native plan instead of running it to completion
  
  msafonov
  and
  claude
  committed
  55c5b6f
- fix: keep a native shuffle's plan out of the task binaries of the stages that read it
  
  msafonov
  and
  claude
  committed
  a7170c2
- perf: intern the query text of scan planning data and native shuffle plans
  
  msafonov
  and
  claude
  committed
  d0c3e79
- test: bound stage task binary sizes against vanilla Spark
  
  msafonov
  and
  claude
  committed
  af29142
- ci: list the suites added by the joom-1.1-2 fixes
  
  msafonov
  and
  claude
  committed
  035ef5c
- style: drop a needless string interpolator flagged by scalafix
  
  msafonov
  and
  claude
  committed
  03c33a5
- test: make the timestamp and task kill suites independent of the Spark version
  
  msafonov
  and
  claude
  committed
  d783931
- fix: take a hash aggregate's groups out before their keys overflow 32-bit offsets
  
  msafonov
  and
  claude
  committed
  6450a99

Navigation Menu

Repository navigation

fix: Joom 1.1-2 — production fixes for shuffle read, offsets, timestamps, native memory, task kill and task binaries - #3

fix: Joom 1.1-2 — production fixes for shuffle read, offsets, timestamps, native memory, task kill and task binaries#3
msafonov merged 14 commits into
branch-1.1from
joom/1.1-fix

Commits on Oct 5, 2026

fix: release each fetched shuffle block once and stop a killed task between blocks

fix: keep 32-bit offsets of repeated and coalesced nested columns from overflowing

fix: compare timestamps whose native producers label their time zone differently

fix: let a native sort's spill merge record what it needs past the sorter's memory

fix: record what a fully ordered final aggregate holds instead of failing

fix: price array grouping keys and dispatched key expressions in the cost-based engine choice

fix: stop a killed task's native plan instead of running it to completion

fix: keep a native shuffle's plan out of the task binaries of the stages that read it

perf: intern the query text of scan planning data and native shuffle plans

test: bound stage task binary sizes against vanilla Spark

ci: list the suites added by the joom-1.1-2 fixes

style: drop a needless string interpolator flagged by scalafix

test: make the timestamp and task kill suites independent of the Spark version

fix: take a hash aggregate's groups out before their keys overflow 32-bit offsets