Pinned Loading

1. LLM-Manager LLM-Manager Public

   一个用于统一管理本地大型语言模型（LLM）的后端服务与监控工具

   Python

2. lmdeploy lmdeploy Public

   Forked from InternLM/lmdeploy

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python

3. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++ 1

4. March7thAssistant March7thAssistant Public

   Forked from moesnow/March7thAssistant

   崩坏：星穹铁道全自动 三月七小助手

   Python

5. 1Cat-vLLM 1Cat-vLLM Public

   Forked from 1CatAI/1Cat-vLLM

   vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V100.

   Python

6. SakuraFRP-Checkin SakuraFRP-Checkin Public

   Forked from RyanStarFox/SakuraFRP_Auto_AI_check

   自动签到樱花FRP，可配置任意OpenAI兼容接口的视觉模型

   Python