Skip to content

fix(tests): replace the filebeat test archive with synthetic cases - #152

Merged
catinspace-au merged 1 commit into
mainfrom
fix/no-elastic-test-data
Nov 15, 2026
Merged

catinspace-au merged 1 commit into
mainfrom
fix/no-elastic-test-data

Conversation

@catinspace-au

Copy link
Copy Markdown
Contributor

The filebeat tests use lines written for this repo.

  • Removed the committed third-party archive tests/fixtures/filebeat/filebeat-testdata.tar.gz and its fetch script scripts/filebeat/fetch_testdata.py.
  • Added tests/fixtures/filebeat/cases.yaml with 31 cases (12 Umbrella, 8 IOS, 11 Meraki). Each names the fields its output must carry. Addresses and names come from the documentation ranges.
  • The in-process filebeat tests, the Kafka e2e test and the PGO driver read the cases through tests/common/filebeat.rs. The e2e test pairs each output to its case by a root _case field.
  • Dropped flate2 and tar from Cargo.toml, since only the archive reader used them. Cargo.lock loses tar, filetime and xattr.
  • Docs and the pgo-workload comments point at tests/fixtures/filebeat/cases.yaml. The gitleaks allowlist no longer names the archive.

On desktop-derek:

  • nextest on the integration binary passes (202).
  • The Kafka e2e filebeat test passes.
  • hyperi-ci check --quick passes.

Under plain cargo test, pipeline_memory::test_pipeline_refuses_a_messagepack_record fails on a metric count (1160, expected 2) even when only the pipeline_memory tests run.

Remove tests/fixtures/filebeat/filebeat-testdata.tar.gz and scripts/filebeat/fetch_testdata.py.

The filebeat integration tests, the Kafka e2e test and the PGO workload now replay 31 lines in tests/fixtures/filebeat/cases.yaml (12 Umbrella, 8 IOS, 11 Meraki). Each case carries the fields its output must have. The e2e test pairs outputs to cases by a root _case field instead of by position.

Cargo.toml drops flate2 and tar, which only the archive reader used. The PGO workload cycles 31 events where it cycled about 370 lines.
@catinspace-au
catinspace-au merged commit afe22c7 into main Nov 15, 2026
24 checks passed
@catinspace-au
catinspace-au deleted the fix/no-elastic-test-data branch November 15, 2026 17:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant