Skip to content

test: verify omitted and explicit Responses WebSocket preconnect - #3968

Merged
markstuart-oai merged 2 commits into
mainfrom
codex/sdk-996-tests
Sep 26, 2026
Merged

markstuart-oai merged 2 commits into
mainfrom
codex/sdk-996-tests

Conversation

@markstuart-oai

Copy link
Copy Markdown
Contributor

The Responses WebSocket preconnect omission fix needs regression coverage across sync and async clients. Add one test file exercising both paths against real local WebSocket upgrades, so an absent optional query field cannot silently turn into an explicit false value. It also covers false and true when supplied.

The file is tests only, with no production, dependency or generated-code changes.

Validation on the committed test bytes:

  • 319/319 selected Responses and WebSocket tests under Pydantic v2.
  • 319/319 under Pydantic v1.
  • 2/2 existing live selectors passed.
  • Changed-file lint and typing checks passed.

@markstuart-oai
markstuart-oai requested a review from a team as a code owner September 26, 2026 21:08
@github-actions

github-actions Bot commented Sep 26, 2026 •

Copy link
Copy Markdown
Contributor

Castiron custom code

✅ No new custom-code files detected.

47 mixed files remain; 0 existing customizations changed.

Compared 384fee3252e2 → e515048e767a. Generated baselines verified.

47 existing customizations unchanged
  • api.md
  • scripts/castiron/README.md
  • scripts/castiron/custom_code_report.py
  • scripts/castiron/test_custom_code_report.py
  • src/openai/init.py
  • src/openai/_client.py
  • src/openai/resources/audio/transcriptions.py
  • src/openai/resources/audio/translations.py
  • src/openai/resources/beta/agents/sessions/sessions.py
  • src/openai/resources/beta/beta.py
  • src/openai/resources/beta/responses/responses.py
  • src/openai/resources/beta/threads/runs/runs.py
  • src/openai/resources/beta/threads/threads.py
  • src/openai/resources/chat/completions/completions.py
  • src/openai/resources/embeddings.py
  • src/openai/resources/files.py
  • src/openai/resources/live/forks.py
  • src/openai/resources/live/live.py
  • src/openai/resources/live/sideband.py
  • src/openai/resources/realtime/api.md
  • src/openai/resources/realtime/realtime.py
  • src/openai/resources/responses/responses.py
  • src/openai/resources/uploads/uploads.py
  • src/openai/resources/vector_stores/file_batches.py
  • src/openai/resources/vector_stores/files.py
  • src/openai/resources/videos.py
  • src/openai/resources/webhooks/init.py
  • src/openai/resources/webhooks/webhooks.py
  • src/openai/types/beta/agent_session_message.py
  • src/openai/types/chat/init.py
  • src/openai/types/chat/chat_completion_message_tool_call.py
  • src/openai/types/fine_tuning/fine_tuning_job_integration.py
  • src/openai/types/realtime/conversation_item_input_audio_transcription_delta_event.py
  • src/openai/types/realtime/realtime_error_event.py
  • src/openai/types/responses/init.py
  • src/openai/types/responses/response.py
  • src/openai/types/responses/response_function_web_search.py
  • src/openai/types/responses/response_function_web_search_param.py
  • src/openai/types/responses/responses_client_event.py
  • src/openai/types/responses/responses_client_event_param.py

7 more in the full report.

A changed generated baseline means this report cannot reliably identify which handwritten lines changed.

Inspect the custom-code diff

Download the exact patch produced by this run (requires repository access):

gh run download 36272294052 --repo openai/openai-python \
  --name castiron-custom-code-36272294052-1 --dir /tmp/castiron-custom-code-36272294052-1
git apply --stat /tmp/castiron-custom-code-36272294052-1/custom-code.patch
cat /tmp/castiron-custom-code-36272294052-1/custom-code.patch

Or reproduce it from an SDK checkout containing the vendored reporter:

git fetch --no-tags origin 384fee3252e2336a85450ff38f9bae41f9199616 e515048e767a2d89f98fa2c47972c607e9e0bf7a
python3 scripts/castiron/custom_code_report.py report \
  --base 384fee3252e2336a85450ff38f9bae41f9199616 \
  --head e515048e767a2d89f98fa2c47972c607e9e0bf7a --fetch --require-head-hash --public \
  --out /tmp/castiron-custom-code-e515048e767a
cat /tmp/castiron-custom-code-e515048e767a/custom-code.patch

This is the current full custom patch for mixed files, not an attribution of only the handwritten lines changed by this PR.

Full report and patch

@openai-sdks

openai-sdks Bot commented Sep 26, 2026 •

Copy link
Copy Markdown
Contributor

OkTest Summary

✅ 236/236 SDK tests passed in 12.217s for Python SDK PR #3968.

Test results — 42 files
Test Result Time
tests/chat-completions-complex-body.test.ts ✅ Passed 237ms
tests/chat-completions-create.test.ts ✅ Passed 380ms
tests/chat-completions-stream.test.ts ✅ Passed 304ms
tests/files-content-binary.test.ts ✅ Passed 245ms
tests/files-create-multipart.test.ts ✅ Passed 246ms
tests/files-list-pagination.test.ts ✅ Passed 182ms
tests/initialize-config.test.ts ✅ Passed 205ms
tests/instance-isolation.test.ts ✅ Passed 217ms
tests/models-list.test.ts ✅ Passed 284ms
tests/responses-background-lifecycle.test.ts ✅ Passed 227ms
tests/responses-body-method-errors.test.ts ✅ Passed 457ms
tests/responses-cancel-timeout.test.ts ✅ Passed 243ms
tests/responses-cancel.test.ts ✅ Passed 250ms
tests/responses-compact-retries.test.ts ✅ Passed 441ms
tests/responses-compact.test.ts ✅ Passed 191ms
tests/responses-create-advanced-stream.test.ts ✅ Passed 125ms
tests/responses-create-advanced.test.ts ✅ Passed 294ms
tests/responses-create-disconnect.test.ts ✅ Passed 1.37s
tests/responses-create-errors.test.ts ✅ Passed 210ms
tests/responses-create-malformed-api-responses.test.ts ✅ Passed 218ms
tests/responses-create-retries.test.ts ✅ Passed 254ms
tests/responses-create-stream-failures.test.ts ✅ Passed 812ms
tests/responses-create-stream-timeout.test.ts ✅ Passed 222ms
tests/responses-create-stream-wire.test.ts ✅ Passed 3.091s
tests/responses-create-stream.test.ts ✅ Passed 274ms
tests/responses-create-terminal-states.test.ts ✅ Passed 295ms
tests/responses-create-timeout.test.ts ✅ Passed 324ms
tests/responses-create.test.ts ✅ Passed 619ms
tests/responses-delete.test.ts ✅ Passed 248ms
tests/responses-input-items-errors.test.ts ✅ Passed 678ms
tests/responses-input-items-list.test.ts ✅ Passed 312ms
tests/responses-input-items-options.test.ts ✅ Passed 487ms
tests/responses-input-tokens-count-timeout.test.ts ✅ Passed 322ms
tests/responses-input-tokens-count.test.ts ✅ Passed 272ms
tests/responses-malformed-inputs.test.ts ✅ Passed 2.165s
tests/responses-not-found-errors.test.ts ✅ Passed 292ms
tests/responses-parse.test.ts ✅ Passed 314ms
tests/responses-retrieve-retries.test.ts ✅ Passed 269ms
tests/responses-retrieve.test.ts ✅ Passed 198ms
tests/responses-stored-method-errors.test.ts ✅ Passed 762ms
tests/retry-behavior.test.ts ✅ Passed 3.288s
tests/sdk-error-shape.test.ts ✅ Passed 428ms

View OkTest run #36272255649

SDK merge (b6d8a6359786) · head (e515048e767a) · base (384fee3252e2) · OkTest (f9111d4e2fcd)

@markstuart-oai
markstuart-oai added this pull request to the merge queue Sep 26, 2026
Merged via the queue into main with commit 43443d1 Sep 26, 2026
26 checks passed
@markstuart-oai
markstuart-oai deleted the codex/sdk-996-tests branch September 26, 2026 23:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants