Skip to content
#

gguf-runner

Star

Here are 7 public repositories matching this topic...

Language: All
Filter by language
All 7 Python 2 Rust 2 Go 1 TypeScript 1

pradeepgudipati / gguf-switchboard

Star 7

Run GGUF through llama.cpp and SafeTensors through vLLM behind one OpenAI-compatible endpoint. Your coding tools select a model; the switchboard manages the local runtime, process, and resident-model change.

openai llama-cpp vllm local-llm llm-inference llm-serve gguf gguf-models vllm-serve openai-compatible gguf-model-support model-swap llm-service gguf-manager vllm-server model-swapping llm-serving-systems gguf-model gguf-runner models-switcher
  • Updated Sep 15, 2026
  • Rust

atomneo / Easy-Local-AI-Image-Generator-Stable-Diffusion-FLUX-Render

Star 1

Render is a lightweight, easy-to-use CLI and local server for generating AI images. Run Stable Diffusion (SD 1.5, SDXL) and FLUX models locally with simple commands like pull and run. Powered by Vulkan acceleration and GGUF support for ultra-fast performance. Think Ollama, but for local image generation.

cli flux local vulkan image-generation vulkan-api client-server vulkan-renderer image-gen stable-diffusion local-ai sdxl stable-diffusion-xl gguf stable-diffusion-ai image-generation-ai image-generation-tool gguf-model-support image-generation-api gguf-runner
  • Updated Aug 31, 2026
  • Go

flatseek / flatrun

Star 0

A complete inference runtime for open-weight large language models, enabling efficient execution through streaming weights, quantization, and memory-aware scheduling

machine-learning deep-learning numpy inference quantization inference-engine memory-mapping inference-optimization kv-cache ai-inference cpu-inference large-language-models llm model-runtime safetensors llm-inference gguf streaming-inference gguf-runner streaming-inference-engine
  • Updated Aug 14, 2026
  • Python

Add this topic to your repo

To associate your repository with the gguf-runner topic, visit your repo's landing page and select "manage topics."

Learn more