Skip to content

Integration test#55

Merged
TheTrueAI merged 2 commits intomainfrom
integration-test
Mar 1, 2026
Merged

Integration test#55
TheTrueAI merged 2 commits intomainfrom
integration-test

Conversation

@TheTrueAI
Copy link
Owner

@TheTrueAI TheTrueAI commented Mar 1, 2026

Closes #21

Copilot AI review requested due to automatic review settings March 1, 2026 02:29
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds end-to-end and UI-level test coverage across the Immermatch pipeline and Streamlit pages, plus CI/coverage configuration updates to enforce baseline quality checks.

Changes:

  • Add Streamlit AppTest-based tests for app.py, pages/verify.py, and pages/unsubscribe.py.
  • Add mocked “full pipeline” integration tests (CV → profile → queries → search → evaluate → summary) and daily task orchestration tests.
  • Update pytest configuration (integration marker), coverage configuration, CI coverage gating, and supporting repo docs/config.

Reviewed changes

Copilot reviewed 12 out of 14 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
tests/test_pages_verify.py Adds Streamlit AppTest coverage for DOI verification page behavior.
tests/test_pages_unsubscribe.py Adds Streamlit AppTest coverage for one-click unsubscribe flow.
tests/test_integration.py Adds mocked end-to-end pipeline integration tests (tech + sustainability CV scenarios).
tests/test_daily_task.py Adds orchestrator-level tests for daily_task.py with all externals mocked.
tests/test_app_ui.py Adds basic UI smoke tests for the Streamlit main app.
pyproject.toml Registers integration marker and adds coverage configuration.
ROADMAP.md Marks integration testing milestone as complete.
AGENTS.md Updates agent workflow guidance to run the full check suite automatically.
.secrets.baseline Updates detect-secrets baseline metadata/config.
.pre-commit-config.yaml Adjusts pre-push test hook to run pytest from .venv.
.gitignore Ignores .coverage artifact.
.github/workflows/ci.yml Enforces a minimum coverage threshold in CI.
.github/copilot-instructions.md Adds repo-specific Copilot instructions (env + testing conventions).
Comments suppressed due to low confidence (1)

.github/workflows/ci.yml:49

  • CI runs coverage with --cov=immermatch, but pyproject.toml now configures coverage sources as immermatch and daily_task. As written, the daily_task.py tests won't count toward the reported coverage, which is confusing given the new config. Either include --cov=daily_task (or drop the --cov=... override and rely on the coverage config) so CI matches the intended coverage scope, or remove daily_task from the coverage source list.
        run: pytest -v --cov=immermatch --cov-report=term --cov-fail-under=60

@pytest.fixture()
def sustainability_cv_text() -> str:
"""Load the sustainability/climate CV fixture."""
return extract_text(str(FIXTURES_DIR / "sustainability_cv.md"))
Copy link

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sustainability_cv_text loads tests/fixtures/sustainability_cv.md, but that fixture file isn't present in tests/fixtures/ (only sample.md / sample.txt exist). This will raise FileNotFoundError and fail the test suite. Add the missing fixture file to tests/fixtures/ or change the test to use an existing fixture filename.

Suggested change
return extract_text(str(FIXTURES_DIR / "sustainability_cv.md"))
return extract_text(str(FIXTURES_DIR / "sample.txt"))

Copilot uses AI. Check for mistakes.
- Add Streamlit AppTest UI tests for verify.py, unsubscribe.py, app.py
- Add daily_task.py tests (expire/purge, query dedup, full pipeline)
- Create .claude/settings.json for Claude Code auto-approve
- Overhaul .vscode/settings.json: broad auto-approve, Copilot instructions
- Create .github/copilot-instructions.md for Copilot Chat
- Add coverage config to pyproject.toml + --cov-fail-under=60 in CI
- Fix pre-push hook to use project venv (language: system)
- Add .coverage to .gitignore, remove from tracking
- Update AGENTS.md with explicit auto-run imperative

229 tests passing, 62% coverage (up from ~55%)
@TheTrueAI TheTrueAI merged commit 5c604d5 into main Mar 1, 2026
4 checks passed
@TheTrueAI TheTrueAI deleted the integration-test branch March 1, 2026 03:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Write integration tests for the full pipeline

2 participants