diff options
| author | Christophe Lyon <christophe.lyon@linaro.org> | 2017-06-01 14:48:26 +0000 |
|---|---|---|
| committer | Christophe Lyon <christophe.lyon@linaro.org> | 2017-06-02 06:52:54 +0000 |
| commit | 01e8914b788ab5363ae7ed7e250322ff4936069f (patch) | |
| tree | c60390906488dca77f399fea3f2743a453235f59 /tcwg-trigger-binutils.yaml | |
| parent | 995997dbb0b7559205cdc7c55aa945883564f8c9 (diff) | |
tcwg-compare-results: Add pass_thresh parameter.
tcwg-trigger-binutils: Set pass_thresh to 0.92.
Some binutils confguration have a low pass rate (about 0.92), because
of many untested/unsupported tests. This causes the non-regression
comparison to return an error even if there was no regression, because
the default minimum expected pass rate is 0.95.
Use the new -pass-thresh comparison parameter, to override the value
for binutils and set it to 0.92 to avoid reporting errors all the
time.
Change-Id: I0174079b73fb56a3ed3252b04329c50b93f52e7b
Diffstat (limited to 'tcwg-trigger-binutils.yaml')
| -rw-r--r-- | tcwg-trigger-binutils.yaml | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/tcwg-trigger-binutils.yaml b/tcwg-trigger-binutils.yaml index e32d013c52..8ec0c5c880 100644 --- a/tcwg-trigger-binutils.yaml +++ b/tcwg-trigger-binutils.yaml @@ -68,6 +68,7 @@ cat << EOF > compare_results_parameters ref_logs=${JOB_NAME}-${ref_build_num} new_logs=${JOB_NAME}-${BUILD_NUMBER} + pass_thresh=0.92 EOF else rm -f compare_results_parameters |