Search results

[FEATURE] First-class whisper (speaches) audio-transcription runtime

enhancementNew feature or requestNew feature or request

Status: Open.

#612 In defilantech/LLMKube;

· Defilan opened on Jun 2, 2026

[FEATURE] Spike: TurboQuant KV on consumer Blackwell (CUDA sm_120): serve Qwen3.6-35B-A3B and benchmark vs NVFP4

area/gpuGPU-related features and issuesGPU-related features and issues

area/performancePerformance optimization and benchmarkingPerformance optimization and benchmarking

enhancementNew feature or requestNew feature or request

Status: Open.

#601 In defilantech/LLMKube;

· Defilan opened on May 30, 2026

[FEATURE] Foreman v0.2 / v0.8.0: close the reviewer-step empirical gap

enhancementNew feature or requestNew feature or request

Status: Open.

#546 In defilantech/LLMKube;

· Defilan opened on May 25, 2026

[FEATURE] metal-agent: honor InferenceService.spec.runtime per-CR (multi-runtime on one agent)

enhancementNew feature or requestNew feature or request

Status: Open.

#525 In defilantech/LLMKube;

· Defilan opened on May 24, 2026

[FEATURE] Opt-in NetworkPolicy in the Foreman chart

area/foremanForeman: the agentic fleet orchestrator add-onForeman: the agentic fleet orchestrator add-on

enhancementNew feature or requestNew feature or request

Status: Open.

#522 In defilantech/LLMKube;

· Defilan opened on May 23, 2026

[FEATURE] CI e2e test for Foreman pipeline (kind + helm + stub AgenticTask)

area/foremanForeman: the agentic fleet orchestrator add-onForeman: the agentic fleet orchestrator add-on

enhancementNew feature or requestNew feature or request

Status: Open.

#521 In defilantech/LLMKube;

· Defilan opened on May 23, 2026

[FEATURE] ValidatingWebhookConfiguration for Agent + AgenticTask CRs

area/foremanForeman: the agentic fleet orchestrator add-onForeman: the agentic fleet orchestrator add-on

enhancementNew feature or requestNew feature or request

Status: Open.

#520 In defilantech/LLMKube;

· Defilan opened on May 23, 2026

[FEATURE] dynamo runtime for InferenceService (heterogeneous datacenter + edge fleet)

area/foremanForeman: the agentic fleet orchestrator add-onForeman: the agentic fleet orchestrator add-on

enhancementNew feature or requestNew feature or request

Status: Open.

#517 In defilantech/LLMKube;

· Defilan opened on May 22, 2026

[FEATURE] llamacpp-router runtime for multi-model InferenceService

area/foremanForeman: the agentic fleet orchestrator add-onForeman: the agentic fleet orchestrator add-on

enhancementNew feature or requestNew feature or request

Status: Open.

#516 In defilantech/LLMKube;

· Defilan opened on May 21, 2026

[FEATURE] InferenceService.spec.speculativeDecoding for llama.cpp MTP / draft-model flags

area/performancePerformance optimization and benchmarkingPerformance optimization and benchmarking

enhancementNew feature or requestNew feature or request

Status: Open.

#502 In defilantech/LLMKube;

· Defilan opened on May 20, 2026

[FEATURE] Tutorial: metrics-driven autoscaling for InferenceService

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

Status: Open.

#478 In defilantech/LLMKube;

· Defilan opened on May 17, 2026

[FEATURE] CI: add a macOS runner for metal-agent coverage

enhancementNew feature or requestNew feature or request

Status: Open.

#455 In defilantech/LLMKube;

· Defilan opened on May 13, 2026