Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 42 additions & 0 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,9 @@ jobs:
AZURE_API_BASE: https://example.openai.azure.com/
PHOENIX_DISABLE_AUTO_INSTRUMENT: '1'
run: python -c "import ${{ matrix.import }}"
- name: Test Phoenix collector against installed client
if: matrix.example == 'phoenix-auto-trace-openai'
run: python source/tests/test_phoenix_collector.py -v
- name: Test Bank Manager model routing
if: matrix.example == 'bank-manager-agent-control'
working-directory: source
Expand All @@ -166,6 +169,45 @@ jobs:
working-directory: source
run: python -m unittest discover -s examples/science_research_agent/tests -p 'test_tools.py' -v

test-phoenix-versions:
name: "Phoenix collector: ${{ matrix.name }}"
needs: build
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
include:
- name: minimum supported
phoenix: '15.0.0'
phoenix_client: '2.1.0'
- name: maximum supported
phoenix: '19.17.0'
phoenix_client: ''
steps:
- uses: actions/setup-python@v5
with:
python-version: '3.11'
- uses: actions/checkout@v4
with:
path: source
- uses: actions/download-artifact@v4
with:
name: dist
path: dist
- name: Install Phoenix compatibility stack
shell: bash
run: |
python -m pip install --upgrade pip
WHEEL="$(ls dist/*.whl)[phoenix]"
PACKAGES=("$WHEEL" "arize-phoenix==${{ matrix.phoenix }}")
if [ -n "${{ matrix.phoenix_client }}" ]; then
PACKAGES+=("arize-phoenix-client==${{ matrix.phoenix_client }}")
fi
python -m pip install "${PACKAGES[@]}"
python -m pip check
- name: Run Phoenix collector compatibility tests
run: python source/tests/test_phoenix_collector.py -v

test-foundry-host-install:
name: "Example install: langgraph-foundry-hosted server"
runs-on: ubuntu-latest
Expand Down
9 changes: 9 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,15 @@ Adds evidence-backed eval authoring, stronger host-authoritative sandbox mediati
- Sandbox policy evaluation, mock resolution, and action evidence can now run in an authenticated host service instead of trusting the evaluated target to report its own decisions (#329).
- Sandbox mediation now propagates and validates one case ID across policy selection, mocks, execution, and evidence (#327).
- Proxy-generated network evidence is stored in a host-only directory outside the evaluated target's writable mount (#326).
- Restore `PhoenixCollector` compatibility with the supported Phoenix client API, including bounded turn-time queries and conversion of Phoenix DataFrame timestamps and indexed span IDs (#339).
- `assert-ai --version` now reads the installed distribution metadata instead of reporting a hard-coded stale version (#334).
- Declare `aiohttp`, which is directly used by the HTTP endpoint target, instead of relying on LiteLLM to install it transitively (#336).
- Update LiteLLM to patched version 1.84.1 and cap it below 2.0 (#330).
- Update vulnerable website, viewer, and Python dependencies to patched releases (#335, #336).
- Keep Bank Manager's GPT and non-GPT Azure routes compatible with ASSERT's OpenAI dependency range, and verify its documented installation with `pip check` (#336).
- Traced callable targets that capture no spans now record an actionable invalid-trace warning instead of silently reporting valid trace metadata (#337).
- Keep viewer result tables within their containers, wrap or truncate long labels, and position metric dropdowns so overflow cannot clip their options (#342).
- Proxy-generated network evidence is stored in a host-only directory outside the evaluated target's writable mount (#326).
- `assert-ai --version` now reads the installed distribution metadata instead of reporting a hard-coded stale version (#334).
- Declare `aiohttp`, which is directly used by the HTTP endpoint target, instead of relying on LiteLLM to install it transitively (#336).
- Update LiteLLM to patched version 1.84.1 and cap it below 2.0 (#330).
Expand Down
Loading
Loading