You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
feat: migrate embeddings from Gunicorn service to Ollama / BYOK providers #146
Replace the custom Python/Gunicorn embedding service (knowledge-embeddings Docker container at :8001) with direct Ollama integration and support for bring-your-own-key (BYOK) providers like OpenAI.
Current State
Knowledge uses EmbeddingServiceInterface backed by a custom EmbeddingService that calls a Gunicorn Python server running BAAI/bge-large-en-v1.5 at http://localhost:8001/embed
This is the same model Ollama already serves locally (bge-large) on the same hardware
The Gunicorn container is a single point of failure with no scaling, no fallback, and extra operational overhead
Proposed Changes
Add Ollama embedding provider — call Ollama's /api/embed endpoint directly (or via laravel/ai if feasible in Laravel Zero)
Add OpenAI-compatible provider — support text-embedding-3-large or any OpenAI-compatible API with an API key
Config-driven provider selection — ~/.knowledge/config.json or env vars to choose provider:
Activity
feat: migrate embeddings to the-shit/vector EmbeddingClient
feat: migrate embeddings to the-shit/vector EmbeddingClient (#147)