gRPC Balancer that routes requests using a consistent hashring
-
Updated
Aug 27, 2025 - Go
#
consistent-hash-ring
Here are 2 public repositories matching this topic...
Context-Ring is a **production-grade reverse proxy** that places session IDs and agent virtual nodes onto a **consistent hash ring**. Prompts from the same long-running task are deterministically routed to the exact same agent instance that already holds the chat history in local memory.
python load-balancer reverse-proxy fastapi local-memory consistent-hash-ring state-preservation deterministic-routing token-cost-optimization ai-agent-swarm context-ring token-cost-reduction graceful-scaling streaming-passthrough zero-state-transfer
-
Updated
Jun 3, 2026 - Python
Improve this page
Add a description, image, and links to the consistent-hash-ring topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the consistent-hash-ring topic, visit your repo's landing page and select "manage topics."