jlama

Here are 2 public repositories matching this topic...

Local LLM inference engine in Java 21 — run GGUF models via REST with SSE streaming (Jlama + llama.cpp)

java spring-boot llm local-llm gguf jlama

demo java-inference jlama

To associate your repository with the jlama topic, visit your repo's landing page and select "manage topics."