Bugzilla – Bug 1847
[feature request] Summary of crashed / failed tests
Last modified: 2014-04-30 16:10:54 EDT
Is it possible to have test.py summarize the list of failed/crashed tests at the end of the run ? I'm not sure about suppressing the PASS ones, as they're useful to see the tests progression. Thanks, T.
Created attachment 1820 [details] patch to provide feature
Peter also asked about this feature; would be useful for testing. Attached is a proposed patch. It does not change the output upon successful full completion (no skips, failed, crashed, valgrind) . It does print out the list of names of each of those categories if one or more exist. Example output below (all of the lines below the line starting with '28 of 30' would be new output in this example): ... PASS: Example src/core/examples/sample-simulator SKIP: Example src/core/examples/main-ptr PASS: Example src/core/examples/sample-random-variable SKIP: Example src/core/examples/sample-simulator.py PASS: TestSuite random-number-generators PASS: TestSuite threaded-simulator PASS: TestSuite random-variable-stream-generators 28 of 30 tests passed (28 passed, 2 skipped, 1 failed, 1 crashed, 0 valgrind errors) List of SKIPped tests: src/core/examples/sample-simulator.py src/core/examples/main-ptr List of FAILed tests: watchdog List of CRASHed tests: examples/tutorial/fourth
Lovely, it's what I had in mind. +1
pushed in changeset 04ea88ac6d8d