Ferrumox

Popular repositories Loading

1. fox fox Public

   A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each pref…

   Rust 187 29

2. rabbit rabbit Public

   Run Qwen 3.8 MAX (2.4T MoE) on a 50GB-RAM consumer machine in pure Rust, experts streamed from disk. Tiny engine, immense model.

   Rust 186 20

3. ferrumox.com ferrumox.com Public

   HTML