Issues

• Capture per-model usage and latency for reproducible LLM tests

  enhancementhelp wantedllm evaluationtests
  StepenkoAnatoli/SmartRouter#61 · Filter by author StepenkoAnatoli opened on Oct 14, 2026

• Benchmark a local or open-weight LLM against the policy tasks

  enhancementhelp wantedllm evaluationtests
  StepenkoAnatoli/SmartRouter#60 · Filter by author StepenkoAnatoli opened on Oct 14, 2026

• Prepare a Gemini comparison adapter and offline evaluation plan

  enhancementhelp wantedllm evaluationtests
  StepenkoAnatoli/SmartRouter#59 · Filter by author StepenkoAnatoli opened on Oct 14, 2026

• Compare Claude profiles with the GPT policy benchmark

  enhancementhelp wantedllm evaluationtests
  StepenkoAnatoli/SmartRouter#58 · Filter by author StepenkoAnatoli opened on Oct 14, 2026

• Repeat GPT model comparisons on a frozen unseen task set

  enhancementhelp wantedllm evaluationtests
  StepenkoAnatoli/SmartRouter#57 · Filter by author StepenkoAnatoli opened on Oct 14, 2026

• Clarify the license scope for skill files and tool code

  documentationmaintainer decisionquestion
  StepenkoAnatoli/SmartRouter#52 · Filter by author StepenkoAnatoli opened on Oct 13, 2026