Skip to content

Fix: Close the gaps Ollama and OpenAI clients hit - #134

Merged
b-re-w merged 2 commits into
developfrom
work/compat-gaps
Oct 3, 2026
Merged

b-re-w merged 2 commits into
developfrom
work/compat-gaps

Conversation

@b-re-w

@b-re-w b-re-w commented Oct 3, 2026

Copy link
Copy Markdown
Member

#118 (SPEC S1.10, S1.15).

Defect fixed

  • HEAD / → 200 (health checks); GET / still serves the web client.
  • /api/version (GET/HEAD) → 1.0.0 from api/src/main/version.py (a test keeps it equal to pyproject.toml); was 0.0.0.
  • Ollama names qwen3, qwen3:latest, qwen3:0.6b, qwen3:0.6b-fp16, default → Qwen/Qwen3-0.6B (case-insensitive); unknown names → 404 listing the available names and that Org/Model ids can be pulled (same text on Ollama and OpenAI).
  • Ollama /api/chat, /api/generate, /api/embed fetch the catalogue model on first use.
  • think: false (Ollama), reasoning_effort: none|minimal or chat_template_kwargs (OpenAI) → enable_thinking in the chat template (Engine.__call__(chat_template_kwargs=), keeps batching).

Test added: api/tests/test_client_compat.py (35; red: 27 failed).

Documentation corrected: README + README_ko, guide server page (en + ko): OLLAMA_HOST=http://127.0.0.1:23100, OPENAI_BASE_URL=…/v1, the API key. SPEC S1.10, S1.15.

Rebased onto #133 (import conflict in ollama_api.py resolved: both UnsupportedModel and in_catalogue).

Closes #118

b-re-w added 2 commits October 3, 2026 14:59
HEAD / now answers 200 for health checks; /api/version returns the real
version (1.0.0, above every Ollama 0.x) instead of 0.0.0. Ollama names
qwen3, qwen3:latest, qwen3:0.6b and qwen3:0.6b-fp16 map to Qwen3-0.6B,
and an unknown name lists the names that exist. The Ollama chat,
generate and embed routes fetch the catalogue model on first use, like
the app and the OpenAI API, so 'ollama run qwen3' works on a fresh
install. think: false (Ollama) and reasoning_effort none/minimal or
chat_template_kwargs (OpenAI) reach the chat template as
enable_thinking. The READMEs and the server guide show how to point the
ollama CLI and OpenAI SDKs at Gemstone.
@b-re-w
b-re-w merged commit 3e65d11 into develop Oct 3, 2026
3 checks passed
@b-re-w
b-re-w deleted the work/compat-gaps branch October 3, 2026 10:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant