request-routing

Connect, secure, control, and observe services.

Apache Syncope

L7mp: A L7 multiprotocol proxy and service mesh

C++17 request routing library

🛡️ Implement a Bare-Metal Safety Gatekeeper for Level 4 Autonomous Vehicles to ensure safe state transitions and prevent critical system failures.

Reverse proxy server written in Go with support for multiple backend URLs, SOCKS5 proxies and URL selection strategies.

An intelligent LLM inference gateway that dynamically routes user queries to optimal model tiers (Llama-3.1 8B/70B) based on real-time complexity, reasoning depth, and ambiguity analysis.

Extensible request routing service with modular processing pipeline and structured logging abstraction. Chain of Responsibility Design Pattern.

Apache Syncope

Discrete-event simulation of LLM request routing across multiple serving instances: round-robin, least-load, prefix-aware, and hybrid cache-aware routing with queue-depth threshold sweep.

Semantic model router with parallel LLM classification, prompt caching, and vision short-circuiting. Optimizes request routing with sub-100ms overhead for Open WebUI.

Go policy engine for edge request governance, redirect control, bot handling, geo routing, and traffic-pressure decisions.

Local-first OpenAI-compatible LLM proxy with smart routing, failover, SQLite telemetry, budgets, response caching, Anthropic translation, and a terminal dashboard.

Calibrated simulation benchmark for real-time LLM request routing, comparing complexity signals, output-length awareness, cost savings, and quality-risk trade-offs.

Resolve and visualise the middleware execution chain for a single Kong or Envoy gateway route - scope precedence, plugin priority and filter order made explicit - then get a diagram, a markdown review summary, and explained risks for ordering hazards like rate limiting before auth or a cache ahead of authentication.

A technical reference for API gateway architecture and request routing — gateway selection, middleware chains, advanced routing, and observability for Kong, Envoy, NGINX, and Tyk.