SparkLLM
Pinned Loading
Repositories
- Spark-X2.6 Public
Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models
- executorch Public Forked from pytorch/executorch
On-device AI across mobile, embedded and edge for PyTorch
- Spark-plugin Public
Spark-plugin for Spark2.5 model, enables seamless loading and serving Spar2.5 large language model within vLLM framework. Implements custom model plugin to support weights loading, tokenizer and inference runtime without modifying original vLLM source code.
-
- TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- dsh-intelligent-router Public
Intelligent LLM routing plugin for DeepSeek Harness: route groups, 4 routing strategies, intent rule engine, cache-affinity Stays mode, auto failover and sample settings UI.
- opencode-XCoSpan Public
Local execution and reviewed cloud collaboration for OpenCode, with routing, redaction, approval, and result delivery.
- codex-XCoSpan Public
Privacy-aware local and cloud model collaboration for Codex, with local redaction and human review.