aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2019-07-18Creating release_90 branch off revision 366426release_90Hans Wennborg
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/branches/release_90@366428 91177308-0d34-0410-b5e6-96231b3b80d8
2019-07-17Fix more -Werror issues with obsequi.Amara Emerson
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@366290 91177308-0d34-0410-b5e6-96231b3b80d8
2019-07-17Obsequi: fix implicit declaration of a function, breaks -Werror builds.Amara Emerson
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@366287 91177308-0d34-0410-b5e6-96231b3b80d8
2019-07-16Enable the obsequi application for Darwin. It seems to run with no issues.Amara Emerson
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@366277 91177308-0d34-0410-b5e6-96231b3b80d8
2019-07-11Fix support for user mode emulation when using cmake/lit.Kristof Beyls
When using user mode emulation, i.e. cross-compiling programs for a different target and running them on a host under qemu user mode emulation, timeit and fpcmp should have host versions, not target versions. Running under user mode emulation had been broken for a while, presumably since https://reviews.llvm.org/rT341257 I first tried an alternative approach where fpcmp would be run under qemu user mode emulation too. That in itself worked, but if going for that approach, for orthogonality reasons, we probably should also run the other helper programs as if they were running on the target, i.e. also under qemu user mode emulation. I ran into issues with running timeit under qemu user mode emulation and also running RunSafely.sh under user mode emulation doesn't seem trivial. In the end, it seemed better to me to explicitly add a cmake option to mark that we're running under qemu user mode emulation, and in that mode, only aim to run the test/benchmark under qemu user mode emulation, rather than also all the helper programs (such as fpcmp, timeit, RunSafely.sh) under it (which is what would be needed if we just kept on using only the RUN_UNDER option for qemu user mode emulation. Differential Revision: https://reviews.llvm.org/D61597 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@365783 91177308-0d34-0410-b5e6-96231b3b80d8
2019-07-10[test-suite] Fix RISC-V Support in benchmark 1.3.0Sam Elliott
Summary: Fixed by backporting the upstream fix from here: https://github.com/google/benchmark/pull/833 Reviewers: lebedev.ri Reviewed By: lebedev.ri Subscribers: asb, kito-cheng, shiva0217, rogfer01, rkruppe, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D64237 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@365610 91177308-0d34-0410-b5e6-96231b3b80d8
2019-06-26Revert "[test-suite] Signal error if llvm-lit was not found"Roman Lebedev
As disscussed in post-commit review, the LIT is not specified in the zorg/buildbot/builders/ClangBuilder.py, so this broke all test-suite bots. That is a bot problem, i'm pulling the commit until is is resolved. This reverts commit r364388. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@364448 91177308-0d34-0410-b5e6-96231b3b80d8
2019-06-26[test-suite] Signal error if llvm-lit was not foundRoman Lebedev
Summary: I'm not sure if that was intentional or not? I found it quite surprising when trying to integrate a new external project. Reviewers: MatzeB, homerdin, hfinkel Reviewed By: hfinkel Subscribers: mgorny, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D60091 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@364388 91177308-0d34-0410-b5e6-96231b3b80d8
2019-06-05Made lambda test more robust.Sunil Srivastava
The test used a lambda that could be optimized out as a constexpr lambda in the C++17 mode, leading to a test faiure due to a missing symbol. This patch avoids that. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@362564 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-11Document how to use the 'vs' mode in compare.pyAmara Emerson
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@358206 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-10[test-suite] litsupport/modules/perf.py: store profile filename in ↵Roman Lebedev
context.profilefile Summary: This 1. Removes duplication 2. Provides that filename to be potentially used by other modules (see D60337) Reviewers: MatzeB, hfinkel, homerdin, fhahn Reviewed By: fhahn Subscribers: fhahn, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D60336 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@358085 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-10[test-suite] There is no such thing as CMAKE_C_CFLAGS, it's CMAKE_C_FLAGSRoman Lebedev
Summary: Noticed by accident. Reviewers: homerdin, MatzeB, hfinkel, fhahn Reviewed By: fhahn Subscribers: fhahn, mgorny, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D60215 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@358084 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-09Fix siod's gc implementation when used with GLIBC.James Y Knight
Patch from LuoYuanke -- In the siod gc, it depends on setjmp(...) to get the value of callee saved register value, and traverse those register to get the possible local object pointer. Also it traverse current stack to get the possible local object pointer. For setjmp(...) on glibc X86-64, the rbp register (callee saved register) is NOT saved in the setjmp buffer, so object that pointed by rbp is NOT considered as local object variable and its memory is collected as garbage. This patch is to use getcontext(...) to get more register value of current context and traverse those register to protect object from garbage collection. This bug is not easy to expose, because usually rbp has been saved in stack when do garbage collection, so the object pointer can be scanned from stack. However when compiler do some optimization on register allocation or licm, the rbp live in gc_mark_and_sweep(...) and rbp is pointing to an object. In such situation, siod failed to run test.scm because object is collected as garbage unexpectedly. Differential Revision: D60039 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@357986 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-04[test-suite] Update test-suite microbenchmarks to use JSON (fix bug 41327)Brian Homerding
Google benchmark is hoping to drop the CSV output format. This updates the microbenchmark module to use the JSON output. This fixes PR41327 Reviewers: lebedev.ri https://reviews.llvm.org/D60205 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@357704 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-03[test-suite,CUDA] Add #include <stdio.h> to test_round.cu to fix a build error.Bixia Zheng
Subscribers: jlebar, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D60168 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@357622 91177308-0d34-0410-b5e6-96231b3b80d8
2019-04-01[test-suite,CUDA] Add a test case to test the edge cases for the ↵Bixia Zheng
implementation of llvm.round intrinsic in the PTX backend. Reviewers: tra Subscribers: sanjoy, mgorny, jlebar, jdoerfert, llvm-commits Tags: #llvm Differential Revision: https://reviews.llvm.org/D59950 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@357430 91177308-0d34-0410-b5e6-96231b3b80d8
2019-03-24[test-suite][mips] Fix compile options for tramp3d-v4 testSimon Atanasyan
The -mxgot flag was negatively effecting certain micromips builds. This patch narrows its use to to only mips64 targets. Patch by Miloš Stojanović. Differential Revision: http://reviews.llvm.org/D59612 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@356863 91177308-0d34-0410-b5e6-96231b3b80d8
2019-03-20Add geomean summary row to output from utils/compare.py.Florian Hahn
This change adds a summary row with the geometric mean of the selected metric to the output of utils/compare.py. The 'rhs' values are normalized to the 'lhs' values and the geometric mean of the results is computed. This should be similar to the geomean row in the LNT HTML UI and allow to compare 2 sets of runs. Reviewers: anemet, MatzeB, cmatthews, serge-sans-paille Reviewed By: anemet Differential Revision: https://reviews.llvm.org/D57828 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@356545 91177308-0d34-0410-b5e6-96231b3b80d8
2019-02-26[CMake] Support alternative C++ ABI libraryPetr Hosek
Do not assume that every platform has libsupc++. Differential Revision: https://reviews.llvm.org/D58598 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@354835 91177308-0d34-0410-b5e6-96231b3b80d8
2019-02-09[test-suite] Add cmake option to use IR PGO (TEST_SUITE_USE_IR_PGO)Vedant Kumar
This allows building programs in the test suite with LLVM's IR PGO feature. Support for re-building programs with the collected profdata is already present. Differential Revision: https://reviews.llvm.org/D57985 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@353591 91177308-0d34-0410-b5e6-96231b3b80d8
2019-02-05Python Compat: print statementsSerge Guelton
Differential Revision: https://reviews.llvm.org/D57744 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@353169 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-28[test-suite] Fix stdthreadbug when building staticAleksandar Beserminji
This patch adds necessary flags for the test stdthreadbug.cpp, so it can be executed without error, when tests are compiled with -static flag. Differential Revision: https://reviews.llvm.org/D52878 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@352385 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-28[test-suite] Adding CoMD Proxy AppBrian Homerding
CoMD is a reference implementation of typical classical molecular dynamics algorithms and workloads. This is a serial build for the test-suite with eam potential. Link: https://github.com/exmatex/CoMD Reviewers: Meinersbur Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@352375 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-20Update remaining file headers of LLVM-project code to the new license.Chandler Carruth
For details, see r351675 which intalled the new license for the test suite, and r351676 which handled headers in the ABI test suite. This also involved cleaning up some weirdly mis-formatted headers in the glib compat stubs. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@351677 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-20Update the file headers used throughout the ABI testsuite to reflect theChandler Carruth
new license. Separating these updates from the rest of the testsuite due to the size of files and impact this has on the system. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@351676 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-20Update LICENSE file for the test-suite to the new license.Chandler Carruth
See r351631 to LLVM which installed the new license and developer policy for subsequent contributions. The test suite project is especially strange due to the fact that there are so many large portions of it that are external projects cloned under their own license into this repository for the purpose of testing. As a consequence, I preserved some of the information in the index of such directories, although I fear it is seriously out of date. Note that I've left odd formatting and other idiosyncracies of the legacy license structure text alone to make the diff easier to read. Critically, note that we do not in any case *remove* the old license notice or terms, as that remains necessary until we finish the relicensing process. In subsequent commits I'll update the file headers of code that is unambiguously part of the LLVM project rather than cloned from somewhere else. These will be separate commits due to the size of some of the code in the test suite. Also, there are confusing cases that will either be handled later once the authors can be consulted, or simply need to remain as-is. For example, we appear to use an old version of some LLVM code as a textual input to a benchmark, and changing it would change the benchmark itself. This also appears to provide no value as the old version will forever be available under the old license anyways. Also, we understand that people may be surprised that we're moving the header entirely to discuss the new license. We checked this carefully with the Foundation's lawyer and we believe this is the correct approach. Essentially, all code in the project is now made available by the LLVM project under our new license, so you will see that the license headers include that license only. Some of our contributors have contributed code under our old license, and accordingly, we have retained a copy of our old license notice in the top-level files in each project and repository. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@351675 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-19Consistently use unix line endings on all the source code in the testChandler Carruth
suite. Only a specific subset were using Windows encodings, and the inconsistency makes updating text like the license needlessly difficult. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@351656 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-10test-suite: add avx512 tests with move-load-store intrinsicsIlia Taraban
Summary: Here is the next bunch of avx512 tests. In each test we do some load, store or move operations and also check result. Reviewers: MatzeB, craig.topper, zvi, RKSimon Reviewed By: RKSimon Subscribers: mgorny, llvm-commits Differential Revision: https://reviews.llvm.org/D51599 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@350816 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-04Make Python scripts portable across Python 2/3Serge Guelton
Mostly: - harmonize print function - harmonize item iteration - explicitly force list creation when needed Differential Revision: https://reviews.llvm.org/D55829 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@350382 91177308-0d34-0410-b5e6-96231b3b80d8
2019-01-04Modernize Python scriptsSerge Guelton
Use type destructuring instead of explicit indexing. This is preparatory work for python2/3 compatibility. Differential Revision: https://reviews.llvm.org/D55989 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@350381 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-26[test-suite][mips] Disable setlocale calls in consumer-typeset testSimon Atanasyan
When running the test-suite through qemu an error can occur when the host and target architecture differ in endianness. This happens when the test calls setlocale. The glibc implementation of this call reads /usr/lib/locale/locale-archive as raw bites. Since the endianness doesn't match, the numbers read from the archive don't make sense and cause the check to fail. This patch disables the setlocale call so the test passes regardless of endianness. Patch by Miloš Stojanović Differential Revision: http://reviews.llvm.org/D55708 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@350066 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-21[test-suite] Revert rL349493 (Adding CoMD Proxy App)Brian Homerding
Test failing. Reverting till fixed. Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349925 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-21[test-suite] Adding CoMD Proxy AppBrian Homerding
Re-commiting CoMD test after fixing the Makefile build. CoMD is a reference implementation of typical classical molecular dynamics algorithms and workloads. This is a serial build for the test-suite with eam potential. Link: https://github.com/exmatex/CoMD Reviewers: Meinersbur Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349922 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-18[test-suite] Revert rL349493 (Adding CoMD Proxy App)Brian Homerding
Test failing. Reverting till fixed. Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349507 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-18[test-suite] Adding CoMD Proxy AppBrian Homerding
Adding floating point tolerance. CoMD is a reference implementation of typical classical molecular dynamics algorithms and workloads. This is a serial build for the test-suite with eam potential. Link: https://github.com/exmatex/CoMD Reviewers: Meinersbur Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349505 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-18[test-suite] Adding CoMD Proxy AppBrian Homerding
CoMD is a reference implementation of typical classical molecular dynamics algorithms and workloads. This is a serial build for the test-suite with eam potential. Link: https://github.com/exmatex/CoMD Reviewers: Meinersbur Differential Revision: https://reviews.llvm.org/D55726 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349493 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-17test-suite: add avx512 tests with miscellaneous intrinsicsIlia Taraban
Summary: Here is another bunch of avx512 tests. In each test we do miscellaneous operations(shuffles, compress, shifts and etc) and also check result. Reviewers: craig.topper, RKSimon, MatzeB, zvi Reviewed By: RKSimon Subscribers: mgorny, eraman, llvm-commits Differential Revision: https://reviews.llvm.org/D51621 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349334 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-15[test-suite] Fix NetBSD buildKamil Rytarowski
No functional change intended for other OSes. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349273 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-15[test-suite] Fix NetBSD support in benchmark 1.3.0Kamil Rytarowski
Fixed by backporting the upstream fix from here: https://github.com/google/benchmark/pull/482 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349272 91177308-0d34-0410-b5e6-96231b3b80d8
2018-12-13test-suite: divide avx512 tests to instruction set subdirectoriesIlia Taraban
Summary: This patch separates current avx512 tests to avx512f, avx512bw and other instruction set directories. This allows to specify tests sets on specific avx512 hardware, for example, knl. Reviewers: RKSimon, MatzeB, craig.topper Reviewed By: RKSimon Subscribers: mgorny, llvm-commits Differential Revision: https://reviews.llvm.org/D55603 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@349039 91177308-0d34-0410-b5e6-96231b3b80d8
2018-11-28[MicroBenchmark] Add initial LoopInterchange test/benchmark.Florian Hahn
This patch adds a first test case specifically for LoopInterchange. I am not sure if MicroBenchmarks is the best place for this, but it seems like a good way to benchmark/tests a set of loops targeted at loop interchange. Reviewers: Meinersbur, homerdin, proton0001, proton, MatzeB Reviewed By: MatzeB Differential Revision: https://reviews.llvm.org/D53030 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@347740 91177308-0d34-0410-b5e6-96231b3b80d8
2018-10-29CMakeLists.txt: Only add rsync target if TEST_SUITE_REMOTE_HOST was specifiedMatthias Braun
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@345539 91177308-0d34-0410-b5e6-96231b3b80d8
2018-10-10cmake: Add TEST_SUITE_EXTRA_*_FLAGS variableMatthias Braun
Introduce TEST_SUITE_EXTRA_C_FLAGS, TEST_SUITE_EXTRA_CXX_FLAGS and TEST_SUITE_EXTRA_EXE_LINKER_FLAGS. They simply get appended at the end of CMAKE_* flags. They are mostly intended for cache files that want settings to take effect even when the user manually overrides CMAKE_* flags. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@344155 91177308-0d34-0410-b5e6-96231b3b80d8
2018-10-03CTMark: Copy lit.local.cfgMatthias Braun
Running the benchmarks (as opposed to just compiling them) didn't work without a lit.local.cfg file switching the mode to "traditional_output". git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@343651 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-27More fixes for UBs in BulletAnton Korobeynikov
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@343219 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-27Fix UB (signed int overflow) in Bullet. The change is the same as already ↵Anton Korobeynikov
present in Bullet mainline. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@343186 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-24[test-suite, CUDA] Enable tests w/ CUDA-10.0Artem Belevich
git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@342931 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-20Disable test MicroBenchmarks/XRay/FDRMode/fdrmode-bench.test on Darwin.Volodymyr Sapsai
Test is failing because `__xray_log_select_mode("xray-fdr")` returns XRAY_MODE_NOT_FOUND. Disable until it is fixed. rdar://problem/44578416 Reviewers: dberris, devnexen Reviewed By: dberris Subscribers: mgorny, dexonsmith, llvm-commits Differential Revision: https://reviews.llvm.org/D52278 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@342676 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-17[XRay] Remove use of deprecated optionsDean Michael Berris
In D51606 we deleted the FDR options struct, but forgot to remove those from the test suite benchmarks. git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@342426 91177308-0d34-0410-b5e6-96231b3b80d8
2018-09-04[test-suite, CUDA] Update CUDA cmake files.Artem Belevich
This should unbreak CUDA buildbots. The problem is that CUDA test suite is generating multiple test executables that all use the same reference output file and that resulted in multiple compilation jobs attempting to create the same symlink at the same time. This patch adds a SUFFIX parameter to make it possible to append a suffix to the target file name and that allows us to avoid name clashes. Differential Revision: https://reviews.llvm.org/D51663 git-svn-id: https://llvm.org/svn/llvm-project/test-suite/trunk@341430 91177308-0d34-0410-b5e6-96231b3b80d8
generated by cgit v1.2.3 (git 2.25.1) at 2024-04-18 23:50:03 +0000