[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

"make check" still succeeds when there are test failures

From: Bruno Haible
Subject: "make check" still succeeds when there are test failures
Date: Sun, 28 Feb 2021 21:16:19 +0100
User-agent: KMail/5.1.3 (Linux/4.4.0-203-generic; KDE/5.18.0; x86_64; ; )

Currently, when DejaGnu is installed, "make check" reports the
number of unexpected failures in its summary, but the exit code
of "make check" is still 0.

It would be more useful if the exit code was set to 1 if there
are unexpected failures, because
  - This is the traditional way a test suite is meant to behave.
  - Then the CI runs would send a failure email, and I could notify you.

I can also make the CI send a failure email without the change,
by grepping the log for the string "unexpected failures". But that
feels like a half-baken approach.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]