Avoid testsuite aliasing in validate_failures.py
This patch adds tracking of current testsuite "tool" and "exp"
to the processing of .sum files. This avoids tests with same
name+description, but from different testsuites, to be aliases.
E.g., this is useful for testsuite/c-c++-common, which is ran
for both gcc and g++ "tools".
After some experimentation it appears that following .sum format
for the manifests is both easy to read and maintain:
=== TOOL tests ===
Running EXP ...
FAIL: test1
...
FAIL: test2
=== TOOL Summary ==
An alternative approach to avoiding aliasing would be prefixing
test names with a prefix like "tool:exp=", but it makes for an
ugly-looking manifests and test reports.
1 file changed