Skip to content

Enable CI tests to fail when test commands fail - #672

Open
jafingerhut wants to merge 10 commits into
p4lang:mainfrom
jafingerhut:whitespace-only-to-test-build-v2
Open

Enable CI tests to fail when test commands fail#672
jafingerhut wants to merge 10 commits into
p4lang:mainfrom
jafingerhut:whitespace-only-to-test-build-v2

Conversation

@jafingerhut

@jafingerhut jafingerhut commented Sep 12, 2026

Copy link
Copy Markdown
Contributor

The step named 'Run tests' in test.yml were failing, but this was masked because of the way that make check -j2 was invoked. This PR changes how it is invoked so that failure of that command causes the CI test to fail, too.

This exposed that with Ubuntu 24.04, some of those tests were failing. The only reason they fail is because several of them enable the use of valgrind on some of the tests, to detect things that valgrind can detect (e.g. accessing memory that has been freed, or never been allocated, or attempts to free already-freed memory, etc.). Those tests pass if we disable valgrind checks. This PR disables valgrind for those tests. If someone wants to examine the C++ code to see why valgrind is reporting those issues, I'd recommend saving that task for a later PR for someone interested in doing so.

Also update googletest from the former version used (dated 2019-May-27) to the version tagged v1.15.2 (dated 2024-Jul-31).

jafingerhut and others added 3 commits September 12, 2026 16:07
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
@github-actions github-actions Bot added the github_actions Pull requests that update GitHub Actions code label Sep 13, 2026
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Before this change, googletest repo version used was dated
2019-May-27, before tag v1.10.x.

Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
@github-actions github-actions Bot added the dependencies Pull requests that update a dependency file label Sep 14, 2026
…nd again

Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
@jafingerhut jafingerhut changed the title Whitespace-only change to exercise CI tests Enable CI tests to fail when test commands fail Sep 14, 2026
because some PI tests failed with valgrind enabled, even with newer
version of googletest.

Signed-off-by: Andy Fingerhut <andy_fingerhut@alum.wustl.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

autoconf dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant