Route Codex through MLflow OSS gateway for Kimi models#180
Open
lilly-luo wants to merge 1 commit into
Open
Conversation
lilly-luo
force-pushed
the
lilly/kimi-codex-agent
branch
from
bb93069 to
1dc24f4
Compare
Codex can now use Databricks model-service OSS models (system.ai.kimi-*) by routing to /ai-gateway/mlflow/v1 while keeping wire_api=responses. - Detects OSS/Kimi models and picks the MLflow base URL. - Falls back to the first OSS model when no GPT model is available. - Adds --model option to ucode codex for explicit model pinning. - Codex availability now includes oss_models.
lilly-luo
force-pushed
the
lilly/kimi-codex-agent
branch
from
1dc24f4 to
17b1b95
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This change lets Codex route through Databricks model-service OSS models (e.g. "system.ai.kimi-k2-7-code") by switching the base URL to
/ai-gateway/mlflow/v1while keeping the OpenAI Responses wire API.Changes:
--modeloption toucode codexfor explicit model pinning.oss_models; OSS discovery is fetched when configuring Codex.Tested:
uv run pytest tests/test_agent_codex.py tests/test_agents_init.py tests/test_cli.py— 205 passeduv run ruff check .— clean