You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Discussion] Adding BufferManager and ThreadPool utilities #50
BufferManager: A centralized mechanism to manage memory buffers efficiently, particularly in scenarios involving high-frequency data processing, streaming, or caching, also control the memory usage and deal with user provided memory.
ThreadPool: A reusable pool of threads to manage task execution and improve concurrency without overwhelming system resources.
For ThreadPool, is there an opportunity to align with future C++ APIs (std::execution) and play well with the ecosystem/avoid having to design our own abstractions?
Activity
lidavidm commentedon Mar 25, 2025
For ThreadPool, is there an opportunity to align with future C++ APIs (std::execution) and play well with the ecosystem/avoid having to design our own abstractions?
wgtmac commentedon Mar 25, 2025
If we have
libiceberg-bundle, we can simply reuse Arrow for all of these. We don't need this in thelibiceberg, right?lidavidm commentedon Mar 25, 2025
Well, Arrow's Executor/ThreadPool is technically an internal API so that may not be ideal
zhjwpku commentedon Oct 23, 2026
Closed as #687 added executor pool support.