Bugzilla – Bug 1847
[feature request] Summary of crashed / failed tests
Last modified: 2014-04-30 16:10:54 EDT
Is it possible to have test.py summarize the list of failed/crashed tests at the end of the run ?
I'm not sure about suppressing the PASS ones, as they're useful to see the tests progression.
Created attachment 1820 [details]
patch to provide feature
Peter also asked about this feature; would be useful for testing. Attached is a proposed patch. It does not change the output upon successful full completion (no skips, failed, crashed, valgrind) . It does print out the list of names of each of those categories if one or more exist. Example output below (all of the lines below the line starting with '28 of 30' would be new output in this example):
PASS: Example src/core/examples/sample-simulator
SKIP: Example src/core/examples/main-ptr
PASS: Example src/core/examples/sample-random-variable
SKIP: Example src/core/examples/sample-simulator.py
PASS: TestSuite random-number-generators
PASS: TestSuite threaded-simulator
PASS: TestSuite random-variable-stream-generators
28 of 30 tests passed (28 passed, 2 skipped, 1 failed, 1 crashed, 0 valgrind errors)
List of SKIPped tests: src/core/examples/sample-simulator.py src/core/examples/main-ptr
List of FAILed tests: watchdog
List of CRASHed tests: examples/tutorial/fourth
Lovely, it's what I had in mind.
pushed in changeset 04ea88ac6d8d