Is it okay for tests to fail, when building with the clang Release cache? (original) (raw)

September 25, 2024, 10:31pm 1

I built clang from source (20.0.0git) using the cache found at clang/cmake/caches/Release.cmake. I ran check-all, where 1 test failed, but then remembered it had to be the stage2- version. And after running stage2-check-all, 17 tests Failed and 10 Timed out:

********************
********************
Timed Out Tests (10):
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/1/16
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/11/16
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/13/16
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/15/16
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/3/16
  Clang-Unit :: ASTMatchers/./ASTMatchersTests/5/16
  lldb-api :: commands/process/attach/TestProcessAttach.py
  lldb-api :: repl/clang/TestClangREPL.py
  lldb-api :: tools/lldb-server/TestLldbGdbServer.py
  llvm-libc++-shared.cfg.in :: std/numerics/rand/rand.dist/rand.dist.bern/rand.dist.bern.negbin/eval.pass.cpp

********************
Failed Tests (17):
  BOLT :: R_ABS.pic.lld.cpp
  BOLT :: max-funcs.test
  BOLT :: runtime/X86/asm-dump.c
  BOLT :: runtime/X86/basic-instrumentation.test
  BOLT :: runtime/X86/exceptions-pic.test
  BOLT :: runtime/X86/fdata-escape-chars.ll
  BOLT :: runtime/X86/instrumentation-dup-jts.s
  BOLT :: runtime/X86/instrumentation-shlib.c
  BOLT :: runtime/X86/retpoline-synthetic.test
  BOLT :: runtime/meta-merge-fdata.test
  Flang :: Lower/location.f90
  LLVM :: CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir
  SanitizerCommon-Unit :: ./Sanitizer-x86_64-Test/SanitizerCommon/FindPathToBinary
  lldb-api :: commands/expression/import-std-module/no-std-module/TestMissingStdModule.py
  lldb-api :: functionalities/asan/TestMemoryHistory.py
  lldb-api :: functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py
  llvm-libc++-shared.cfg.in :: std/time/time.zone/time.zone.timezone/time.zone.members/sys_info.zdump.pass.cpp


Testing Time: 2697.37s

Total Discovered Tests: 130986
  Skipped          :     53 (0.04%)
  Unsupported      :   5588 (4.27%)
  Passed           : 124978 (95.41%)
  Expectedly Failed:    340 (0.26%)
  Timed Out        :     10 (0.01%)
  Failed           :     17 (0.01%)

Will this cause any problems, or is it fine?
I would give you the error message for each test, but the stdout is HUGE. If it is stored in a log file somewhere I can get that instead if needed.
Doubt there will be troubleshooting, but just in case I should probably mention it was built with clang and lld version 18.1.8, on a WSL 2.3.22 VM running Arch. Built from github commit hash: 4a9da96dc

tstellar September 26, 2024, 12:28am 2

I think is is fine or at least it doesn’t look like the compiler is completely broken. We still have a few failing tests on the release/19.x branch for our official Linux builds too. I would be curious to see the test output for those failures, though. It’s possible they could be failing due to out-of-memory conditions if you have a low memory to CPU ratio.

Can i find the output in a log somewhere? I tried to look in all the .log files that had */bolt/* in their path. But couldn’t find something related to tests in the files.

llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/X86/Output/bb-with-two-tail-calls.s.tmp.log
llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/X86/Output/shared_object_entry.s.tmp.log
llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/X86/Output/log.test.tmp.log

I could only find 1 warning in all of those files, and it was just bad padding.
BOLT-WARNING: bad padding at address 0x4011b3 starting at offset 13 in function usqrt
I haven’t looked in other log files, since I doubt I will find much.

tstellar September 26, 2024, 12:44pm 4

There is not test log. Everything is output to stdout or stderr.

Regarding your first comment, I have had failures in the past with out-of-memory issues. But that was when trying to build RelWithDebInfo and LTO.
I have 12 logical processors and the WSL VM has access to 26 GB of ram and 16GB of SWAP. I didn’t check how much memory the tests were consuming, so I’m not sure if the tests could have failed there.

I ran the stage2-check-all target again and here are some results that i could find:

BOLT Failure:

********************
FAIL: BOLT :: runtime/X86/basic-instrumentation.test (14 of 103282)
******************** TEST 'BOLT :: runtime/X86/basic-instrumentation.test' FAILED ********************
Exit Code: 1

Command Output (stdout):
--
BOLT-INFO: shared object or position-independent executable detected
BOLT-INFO: Target architecture: x86_64
BOLT-INFO: BOLT version: 4a9da96dc68d878893399210888a03117b39b802
BOLT-INFO: first alloc address is 0x0
BOLT-INFO: creating new program header table at address 0x200000, offset 0x200000
BOLT-INFO: enabling relocation mode
BOLT-INFO: forcing -jump-tables=move for instrumentation
BOLT-INFO: enabling lite mode
BOLT-INFO: 0 out of 4 functions in the binary (0.0%) have non-empty execution profile
BOLT-INSTRUMENTER: Number of indirect call site descriptors: 1
BOLT-INSTRUMENTER: Number of indirect call target descriptors: 3
BOLT-INSTRUMENTER: Number of function descriptors: 3
BOLT-INSTRUMENTER: Number of branch counters: 1
BOLT-INSTRUMENTER: Number of ST leaf node counters: 3
BOLT-INSTRUMENTER: Number of direct call counters: 0
BOLT-INSTRUMENTER: Total number of counters: 4
BOLT-INSTRUMENTER: Total size of counters: 32 bytes (static alloc memory)
BOLT-INSTRUMENTER: Total size of string table emitted: 17 bytes in file
BOLT-INSTRUMENTER: Total size of descriptors: 260 bytes in file
BOLT-INSTRUMENTER: Profile will be saved to file /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp
BOLT-INFO: padding code to 0x600000 to accommodate hot text
BOLT-INFO: output linked against instrumentation runtime library, lib entry point is 0x606980
BOLT-INFO: clear procedure is 0x6023e0
BOLT-INFO: setting _end to 0x60a094
BOLT-INFO: setting __bolt_runtime_start to 0x606940
BOLT-INFO: setting __bolt_runtime_fini to 0x606980
BOLT-INFO: setting __hot_start to 0x400000
BOLT-INFO: setting __hot_end to 0x4000f8
Nothing to remove

--
Command Output (stderr):
--
RUN: at line 5: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang /home/christoffer/dev/llvm-project/bolt/test/runtime/X86/Inputs/basic-instrumentation.s -Wl,-q -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.exe
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang /home/christoffer/dev/llvm-project/bolt/test/runtime/X86/Inputs/basic-instrumentation.s -Wl,-q -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.exe
RUN: at line 6: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llvm-bolt --runtime-instrumentation-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_instr.a --runtime-hugify-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_hugify.a /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.exe -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp --instrument    --instrumentation-file=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp    --instrumentation-file-append-pid
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llvm-bolt --runtime-instrumentation-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_instr.a --runtime-hugify-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_hugify.a /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.exe -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp --instrument --instrumentation-file=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp --instrumentation-file-append-pid
RUN: at line 11: rm /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.*.fdata || echo Nothing to remove
+ rm '/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.*.fdata'
rm: cannot remove '/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.*.fdata': No such file or directory
+ echo Nothing to remove
RUN: at line 12: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp
RUN: at line 15: mv /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.*.fdata /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.fdata
+ mv /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.4692.fdata /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.fdata
RUN: at line 16: cat /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.fdata | /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/FileCheck -check-prefix=CHECK /home/christoffer/dev/llvm-project/bolt/test/runtime/X86/basic-instrumentation.test
+ cat /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/runtime/X86/Output/basic-instrumentation.test.tmp.fdata
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/FileCheck -check-prefix=CHECK /home/christoffer/dev/llvm-project/bolt/test/runtime/X86/basic-instrumentation.test
/home/christoffer/dev/llvm-project/bolt/test/runtime/X86/basic-instrumentation.test:22:8: error: CHECK: expected string not found in input
CHECK: main 0 0 1{{$}}
       ^
<stdin>:1:1: note: scanning from here
1 _init 12 1 _init 16 0 1
^
<stdin>:2:18: note: possible intended match here
0 [unknown] 0 1 _init 0 0 1
                 ^

Input file: <stdin>
Check file: /home/christoffer/dev/llvm-project/bolt/test/runtime/X86/basic-instrumentation.test

-dump-input=help explains the following input dump.

Input was:
<<<<<<
            1: 1 _init 12 1 _init 16 0 1
check:22'0     X~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
            2: 0 [unknown] 0 1 _init 0 0 1
check:22'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:22'1                      ?           possible intended match
            3: 0 [unknown] 0 1 _fini 0 0 1
check:22'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>>>>>>

--

And another BOLT failure:

********************
FAIL: BOLT :: R_ABS.pic.lld.cpp (15 of 103282)
******************** TEST 'BOLT :: R_ABS.pic.lld.cpp' FAILED ********************
Exit Code: 1

Command Output (stdout):
--
BOLT-INFO: shared object or position-independent executable detected
BOLT-INFO: Target architecture: x86_64
BOLT-INFO: BOLT version: 4a9da96dc68d878893399210888a03117b39b802
BOLT-INFO: first alloc address is 0x0
BOLT-INFO: creating new program header table at address 0x200000, offset 0x200000
BOLT-INFO: enabling relocation mode
BOLT-INFO: enabling lite mode
BOLT-INFO: 0 out of 4 functions in the binary (0.0%) have non-empty execution profile
BOLT-INFO: 1 instructions were shortened

--
Command Output (stderr):
--
RUN: at line 9: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang  --target=x86_64-unknown-linux-gnu -fPIE -fuse-ld=lld -Wl,--unresolved-symbols=ignore-all -pie -fPIC -shared /home/christoffer/dev/llvm-project/bolt/test/R_ABS.pic.lld.cpp -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so -Wl,-q -fuse-ld=lld
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang --target=x86_64-unknown-linux-gnu -fPIE -fuse-ld=lld -Wl,--unresolved-symbols=ignore-all -pie -fPIC -shared /home/christoffer/dev/llvm-project/bolt/test/R_ABS.pic.lld.cpp -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so -Wl,-q -fuse-ld=lld
clang: warning: argument unused during compilation: '-pie' [-Wunused-command-line-argument]
RUN: at line 10: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llvm-bolt --runtime-instrumentation-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_instr.a --runtime-hugify-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_hugify.a /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so.bolt --relocs
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llvm-bolt --runtime-instrumentation-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_instr.a --runtime-hugify-lib=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/bolt_rt-bins/lib/libbolt_rt_hugify.a /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so -o /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/bolt/test/Output/R_ABS.pic.lld.cpp.tmp.so.bolt --relocs
BOLT-ERROR: unable to get new address corresponding to input address 0x1550 in function .text/1. Consider adding this function to --skip-funcs=...

--

Here is one from lldb-api:

FAIL: lldb-api :: functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py (17 of 103282)
******************** TEST 'lldb-api :: functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py' FAILED ********************
Script:
--
/usr/sbin/python3.12 /home/christoffer/dev/llvm-project/lldb/test/API/dotest.py -u CXXFLAGS -u CFLAGS --env ARCHIVER=/home/christoffer/dev/llvm-project/build/bin/llvm-ar --env OBJCOPY=/home/christoffer/dev/llvm-project/build/bin/llvm-objcopy --env LLVM_LIBS_DIR=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./lib --env LLVM_INCLUDE_DIR=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/include --env LLVM_TOOLS_DIR=/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./bin --libcxx-include-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/include/c++/v1 --libcxx-include-target-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/include/x86_64-unknown-linux-gnu/c++/v1 --libcxx-library-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./lib/x86_64-unknown-linux-gnu --arch x86_64 --build-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/lldb-test-build.noindex --lldb-module-cache-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/lldb-test-build.noindex/module-cache-lldb/lldb-api --clang-module-cache-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/lldb-test-build.noindex/module-cache-clang/lldb-api --executable /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./bin/lldb --compiler /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./bin/clang --dsymutil /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./bin/dsymutil --llvm-tools-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./bin --lldb-obj-root /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/tools/lldb --lldb-libs-dir /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/./lib /home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump -p TestProcessSaveCoreMinidump.py
--
Exit Code: 1

Command Output (stdout):
--
lldb version 20.0.0git (git@github.com:llvm/llvm-project.git revision 4a9da96dc68d878893399210888a03117b39b802)
  clang revision 4a9da96dc68d878893399210888a03117b39b802
  llvm revision 4a9da96dc68d878893399210888a03117b39b802
Skipping the following test categories: ['dsym', 'gmodules', 'debugserver', 'objc']
Error: None
Error: None

--
Command Output (stderr):
--
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_default_options_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dsym) (test case does not fall in any category of interest for this run)
FAIL: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_default_options_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwarf)
FAIL: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_default_options_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwo)
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dsym) (test case does not fall in any category of interest for this run)
FAIL: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwarf)
FAIL: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwo)
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_thread_options_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_thread_options_dsym) (test case does not fall in any category of interest for this run)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_thread_options_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_thread_options_dwarf)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_mini_dump_thread_options_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_thread_options_dwo)
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_minidump_one_region_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_minidump_one_region_dsym) (test case does not fall in any category of interest for this run)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_minidump_one_region_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_minidump_one_region_dwarf)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_linux_minidump_one_region_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_minidump_one_region_dwo)
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_dsym) (test case does not fall in any category of interest for this run)
UNSUPPORTED: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_duplicated_regions_dsym (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_duplicated_regions_dsym) (test case does not fall in any category of interest for this run)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_duplicated_regions_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_duplicated_regions_dwarf)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_duplicated_regions_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_duplicated_regions_dwo)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_dwarf)
PASS: LLDB (/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang-x86_64) :: test_save_minidump_custom_save_style_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_minidump_custom_save_style_dwo)
======================================================================
FAIL: test_save_linux_mini_dump_default_options_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwarf)
    Test that we can save a Linux mini dump with default SBSaveCoreOptions
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1768, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/decorators.py", line 148, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 334, in test_save_linux_mini_dump_default_options
    self.verify_core_file(
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 41, in verify_core_file
    self.assertEqual(module_file_name, expected_file_name)
AssertionError: 'libstdc++.so.6' != 'libc++abi.so.1'
- libstdc++.so.6
+ libc++abi.so.1

Config=x86_64-/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang
======================================================================
FAIL: test_save_linux_mini_dump_default_options_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_default_options_dwo)
    Test that we can save a Linux mini dump with default SBSaveCoreOptions
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1768, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/decorators.py", line 148, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 334, in test_save_linux_mini_dump_default_options
    self.verify_core_file(
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 41, in verify_core_file
    self.assertEqual(module_file_name, expected_file_name)
AssertionError: 'libstdc++.so.6' != 'libc++abi.so.1'
- libstdc++.so.6
+ libc++abi.so.1

Config=x86_64-/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang
======================================================================
FAIL: test_save_linux_mini_dump_dwarf (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwarf)
    Test that we can save a Linux mini dump.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1768, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/decorators.py", line 148, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 135, in test_save_linux_mini_dump
    self.verify_core_file(
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 41, in verify_core_file
    self.assertEqual(module_file_name, expected_file_name)
AssertionError: 'libstdc++.so.6' != 'libc++abi.so.1'
- libstdc++.so.6
+ libc++abi.so.1

Config=x86_64-/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang
======================================================================
FAIL: test_save_linux_mini_dump_dwo (TestProcessSaveCoreMinidump.ProcessSaveCoreMinidumpTestCase.test_save_linux_mini_dump_dwo)
    Test that we can save a Linux mini dump.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1768, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/packages/Python/lldbsuite/test/decorators.py", line 148, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 135, in test_save_linux_mini_dump
    self.verify_core_file(
  File "/home/christoffer/dev/llvm-project/lldb/test/API/functionalities/process_save_core_minidump/TestProcessSaveCoreMinidump.py", line 41, in verify_core_file
    self.assertEqual(module_file_name, expected_file_name)
AssertionError: 'libstdc++.so.6' != 'libc++abi.so.1'
- libstdc++.so.6
+ libc++abi.so.1

Config=x86_64-/home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/clang
----------------------------------------------------------------------
Ran 18 tests in 11.868s

FAILED (failures=4, skipped=6)

--

And the last I could find was an LLVM error:

********************
FAIL: LLVM :: CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir (16 of 103282)
******************** TEST 'LLVM :: CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir' FAILED ********************
Exit Code: 1

Command Output (stderr):
--
RUN: at line 2: /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llc -mtriple=amdgcn-mesa-mesa3d -mcpu=tahiti -run-pass=instruction-select -global-isel-abort=2 -pass-remarks-missed='gisel*'  -o - /home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir | /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/FileCheck -check-prefix=GCN  /home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/llc -mtriple=amdgcn-mesa-mesa3d -mcpu=tahiti -run-pass=instruction-select -global-isel-abort=2 '-pass-remarks-missed=gisel*' -o - /home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir
+ /home/christoffer/dev/llvm-project/build/tools/clang/stage2-instrumented-bins/tools/clang/stage2-bins/bin/FileCheck -check-prefix=GCN /home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir
remark: <unknown>:0:0: cannot select: %5:sgpr_96(<3 x s32>), %6:sgpr_96(<3 x s32>), %7:sgpr_96(<3 x s32>), %8:sgpr_96(<3 x s32>) = G_UNMERGE_VALUES %4:sgpr_384(<12 x s32>) (in function: test_unmerge_s_v3s32_s_v12s32)
/home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir:174:14: error: GCN-NEXT: expected string not found in input
 ; GCN-NEXT: [[DEF:%[0-9]+]]:sgpr(s192) = G_IMPLICIT_DEF
             ^
<stdin>:968:2: note: scanning from here

 ^
<stdin>:969:2: note: possible intended match here
 %0:sgpr_192 = IMPLICIT_DEF
 ^

Input file: <stdin>
Check file: /home/christoffer/dev/llvm-project/llvm/test/CodeGen/AMDGPU/GlobalISel/inst-select-unmerge-values.mir

-dump-input=help explains the following input dump.

Input was:
<<<<<<
            .
            .
            .
          963:  longBranchReservedReg: ''
          964:  hasInitWholeWave: false
          965: body: |
          966:  bb.0:
          967:  liveins: $sgpr0_sgpr1_sgpr2_sgpr3
          968:
next:174'0      X error: no match found
          969:  %0:sgpr_192 = IMPLICIT_DEF
next:174'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
next:174'1      ?                           possible intended match
          970:  %1:sreg_64 = COPY %0.sub0_sub1
next:174'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
          971:  %2:sreg_64 = COPY %0.sub2_sub3
next:174'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
          972:  %3:sreg_64 = COPY %0.sub4_sub5
next:174'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
          973:  S_ENDPGM 0, implicit %1, implicit %2, implicit %3
next:174'0     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
          974:
next:174'0     ~
            .
            .
            .
>>>>>>

--

I couldn’t find the other errors before they dissapeared when stdout got too large.
The same tests failed as in my original post, although 7 more timed out this time.