Add stream pool to avoid cuStreamCreate overhead #2012

Activity

1. simonbyrne

   added

   bug

   on Jul 29, 2023
2. maleadt

   added

   enhancement

   good first issueGood for newcomersGood for newcomers

   performanceRuntime performance.Runtime performance.

   and removed

   bug

   on Aug 11, 2023
3. maleadt

   changed the title [-]CuStreamCreate overhead when using multiple tasks[/-] [+]Add stream pool to avoid cuStreamCreate overhead[/+] on Aug 11, 2023
4. maleadt

   added

   runtimeHost runtime: devices, contexts, streams, synchronization, memory management, multi-GPU, profiling.Host runtime: devices, contexts, streams, synchronization, memory management, multi-GPU, profiling.

   and removed

   good first issueGood for newcomersGood for newcomers

   on Oct 19, 2026
5. maleadt

   added the

   Enhancement

   issue type on Oct 19, 2026
6. maleadt commented on Oct 19, 2026

   

   maleadt

   on Oct 19, 2026

   Member

   More actions

   Fixed by #3317: the streams of finished tasks are now kept in a per-context pool and handed to new tasks, so spawning tasks no longer calls cuStreamCreate every time.
7. maleadt

   closed this as completedon Oct 19, 2026