Skip to content
#

split-inference

Star

Here are 2 public repositories matching this topic...

kadubon / split-inference-bench

Sponsor
Star 0

Fixed-budget multi-agent inference benchmark harness for studying when split inference helps or hurts versus a strong single-agent baseline under local context ceilings, using local Ollama gemma3:1b, CPU-only pilots, topology diagnostics, verification-budget analysis, and reproducible experiment logging.

ai topology multi-agent-systems split-inference mixture-of-experts ai-evaluation llm-benchmark inference-allocation fixed-budget local-context experiment-harness
  • Updated Mar 12, 2026
  • Python

Improve this page

Add a description, image, and links to the split-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the split-inference topic, visit your repo's landing page and select "manage topics."

Learn more