fix: prevent process hang when vLLM engine dies during async generation#1691
Open
dinhxuanvu wants to merge 1 commit into
Open
fix: prevent process hang when vLLM engine dies during async generation#1691dinhxuanvu wants to merge 1 commit into
dinhxuanvu wants to merge 1 commit into