Skip to content

skip gpt-5-6 in e2e tests for now #179

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lilly-luo merged 5 commits into from
Jul 1, 2026
Merged

skip gpt-5-6 in e2e tests for now #179

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
8ab801f
fix(tests/e2e): avoid /tmp for Codex home and skip gpt-5-6 Copilot mo…
lilly-tecton Jul 1, 2026
dd7986b
update
lilly-tecton Jul 1, 2026
7871dd2
update
lilly-tecton Jul 1, 2026
abf853f
add logs
lilly-tecton Jul 1, 2026
26f93b7
Merge branch 'main' into lilly-luo_data/fix-e2e-tests
lilly-luo Jul 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions tests/test_e2e.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -404,6 +404,11 @@ class TestCodexLaunch:
CODEX_INCOMPATIBLE_MODEL_FRAGMENTS = (
# nano endpoint is unreliably slow and times out past the 60s budget.
"gpt-5-4-nano",
# These endpoints are discoverable as responses-capable, but the
# backing OpenAI endpoint returns ENDPOINT_NOT_FOUND in the CI region.
"gpt-5-6-luna",
"gpt-5-6-sol",
"gpt-5-6-terra",
)

def _codex_models(self, e2e_state: dict) -> list[str]:
Expand Down Expand Up @@ -812,6 +817,8 @@ class TestCopilotLaunch:
# gpt-5.5 rejects function tools + reasoning_effort on /chat/completions
# ("Please use /v1/responses instead").
"gpt-5-5",
# gpt-5.6 models similarly reject /chat/completions with 404.
"gpt-5-6",
)

def _all_models(self, e2e_state: dict) -> list[tuple[str, str]]:
Expand Down
Loading