Repository navigation
Conversation
JslYoon
requested review from
a team,
gabemontero and
maysunfaisal
as code owners
October 5, 2026 17:42
JslYoon
force-pushed
the
ogx-client-migration
branch
from
October 5, 2026 17:45
071669e to
aa37b12
Compare
Migrate this sample from Llama Stack to OGX (Open GenAI Stack) 1.2.5, the upstream rename of Llama Stack. Covers the Python app SDK, the server runtime config, the Backstage/RHDH software template, k8s resource names, and docs. App SDK: replace llama-stack-client/llama-stack with ogx-client==1.2.5. List endpoints now return a response object with a .data list; create endpoints take request objects; files.create takes a str path. Type remaps are aliased to the old names to minimize churn. Add an explicit openai>=2.14.0,<3 dependency (previously transitive) pinned below v3, which drifts the beta.chat.completions.parse surface the code uses. Server + template + infra: rebrand to OGX. Server deps/config move under start-local-ogx/, run.yaml migrates to the OGX 1.2.5 API surface, and k8s/template resources use the -ogx naming and agentic-ogx runtime image. Docs updated. Also bundled: safety check runs via Llama Guard chat instead of /v1/moderations; unknown classification routing renders a graceful prompt instead of an error; the server starts with --insecure. Kept intentionally: env var names LLAMA_STACK_URL / LLAMA_STACK_SERVER_OPENAI (values point at the renamed -ogx service), config key llamastack:, check_llama_stack_availability, and the ollama/llama-guard/.llama data dirs. Template images point at quay.io/redhat-ai-dev/*. 180 unit tests pass; ruff clean. Unit tests are mocked and do not prove runtime correctness against a live OGX server. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
JslYoon
force-pushed
the
ogx-client-migration
branch
from
October 5, 2026 17:56
aa37b12 to
79cf306
Compare
Contributor
|
use of a local ogx instance is not working (the instance does not come up) ... I've reported it to @JslYoon and he is working it in the interim I'm pivoting to deploying on OCP and giving that a go |
Signed-off-by: Lucas <lyoon@redhat.com>
Contributor
|
so @JslYoon the ogx deployment is failing when I launch the template because it tries to pull the image
which does not exist looking at https://quay.io/organization/redhat-ai-dev there is an IIRC @maysunfaisal did work to get the agentic-llama-stack image out there ... now, you probably want a newer image for OGX, so there is more involved than just retagging / renaming that image |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Migrates this sample from Llama Stack to OGX (Open GenAI Stack) 1.2.5, the upstream rename of Llama Stack. Covers the Python app SDK, the server runtime config, the Backstage/RHDH software template, k8s resource names, and docs.
https://redhat.atlassian.net/browse/RHIDP-15863
https://redhat.atlassian.net/browse/RHIDP-17526
What changed
App SDK —
llama-stack-client/llama-stackreplaced withogx-client==1.2.5:OgxClient(base_url=...); list endpoints now return a response object with a.datalist (vector_stores.list().data,vector_stores.files.list(...).data,models.list().data) instead of being directly iterable.vector_stores.create(OpenAICreateVectorStoreRequestWithExtraBody(name=...)),vector_stores.files.create(open_ai_attach_file_request=OpenAIAttachFileRequest(file_id=...)).files.create(file=<str path>, purpose=...)takes a str path (preserves basename).OpenAIResponseObject,OpenAIFileObject,OpenAIResponseOutputMessageFileSearchToolCallResults).openai>=2.14.0,<3(previously a transitive dep of llama-stack-client; pinned <3 because v3 drifts thebeta.chat.completions.parsesurface the code uses).Server + template + infra — rebranded to OGX:
start-local-ogx/(wasstart-local-llamastack/);run.yamlmigrated to the OGX 1.2.5 API surface.ogx-agentic), secretogx-secrets, k8s resources (${name}-ogx,service-ogx), runtime sidecar imageagentic-ogx.Fixes bundled in:
/v1/moderations.unknownclassification routing renders a graceful prompt instead of an error.--insecure(no TLS certs required locally).Kept intentionally: env var names
LLAMA_STACK_URL/LLAMA_STACK_SERVER_OPENAI(their values point at the renamed-ogxservice), config keyllamastack:,check_llama_stack_availability, andollama/llama-guard/.llamadata dirs. Repo name unchanged.Testing
ruffclean.Note on images
Template
appContainer/ogxContainerpoint atquay.io/redhat-ai-dev/*.redhat-ai-dev/agentic-ogx:latestis not published yet — upstream CI needs to build/publish it for deploys to pull the OGX runtime sidecar.🤖 Generated with Claude Code