Skip to content

fix(vllm): validate persistent container configuration - #327

Draft
nvddr wants to merge 1 commit into
mainfrom
agent/vllm-config-fingerprint
Draft

fix(vllm): validate persistent container configuration#327
nvddr wants to merge 1 commit into
mainfrom
agent/vllm-config-fingerprint

Conversation

@nvddr

@nvddr nvddr commented Jul 31, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • label repository-owned vLLM containers with a deterministic launch fingerprint
  • reuse healthy or stopped containers only when their launch contract matches
  • recreate stale or unlabeled containers before model startup

Why

A persistent container could be restarted with model arguments, GPU assignment, or memory limits from an older profile even after the active YAML changed.

Validation

  • uv run --project tests pytest -q tests/test_vllm_docker.py
  • ruff check on changed Python files
  • SPDX header check

Signed-off-by: Devdeep Ray <devdeepr@Nvidia.com>
@nvddr
nvddr force-pushed the agent/vllm-config-fingerprint branch from e34df37 to d3c198e Compare July 31, 2026 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant