批量测试符合 OpenAI 协议和 Anthropic 协议的 AI 模型性能指标。支持 TTFT（首字节时间）、TPS（吞吐量）、网络延迟等关键性能指标的测量，提供多模型对比测试和详细的性能报告生成功能。

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

A Go CLI tool to benchmark local LLMs via Ollama, measuring Time To First Token (TTFT) and throughput on your specific hardware.

LLM inference benchmarking toolkit. Measure TTFT, inter-token latency, throughput, and P50–P99 across concurrency levels.

CLI benchmark suite for LLM providers and OpenAI-compatible gateways. Measure TTFT, latency, p95, throughput, warmup, and history.

The only voice agent context manager with a TTFT feedback loop

Throughput + latency benchmark for OpenAI-compatible LLM endpoints (vLLM, TGI, llama.cpp, Ollama). TTFT, TPOT, throughput, percentiles. Model-agnostic.

Prometheus exporter for LLM API monitoring — probes OpenAI, Anthropic, Google Gemini, Azure OpenAI and any OpenAI-compatible endpoint, collecting TTFT, latency, token usage and availability metrics.

Platform-agnostic benchmark harness for LLM inference endpoints. Measures TTFT, throughput, and failure rate against any OpenAI-compatible /v1/completions API (vLLM, SGLang, Baseten, RHOAI, …) and recommends a vLLM config grounded in real benchmark data.

Mesure les métriques d'inférence LLM (TTFT, TPOT, débit, coût, VRAM) sur n'importe quelle API OpenAI-compatible. Inclut infer-serve pour héberger un GGUF via llama.cpp en une commande.

LLM inference benchmark CLI

An asynchronous, neuro-symbolic VLA (Vision-Language-Action) orchestration stack for edge autonomy. Fuses probabilistic Qwen2-VL visual reasoning and faster-whisper ASR with deterministic PX4/MAVSDK flight-control loops and HSV color guardrails.

Applies some fixes for nonfunction algorithms where functions are not implemented. A sort of critique of a published book, no functions are implemented. Mabye it would help if mathematics was taught in a more programmatic way, because it would allow the user to get an algorithmic perspective on an otherwise simple seeming equation. This was the …