[llvm-dev] [lit] check-all hanging (original) (raw)

Kuba Mracek via llvm-dev llvm-dev at lists.llvm.org
Thu Jan 3 07:53:25 PST 2019

+Fred, +Kostya

Sent from my iPhone

On Jan 3, 2019, at 7:33 AM, Joel E. Denny via llvm-dev <llvm-dev at lists.llvm.org> wrote:

All, Thanks for the replies. Kuba: For LLDB, when were things expected to have improved? It's possible things improved for me at some point, but this isn't something I've found time to track carefully, and I still see problems. I ran check-all a couple of times last night at r350238, which I pulled yesterday. Here are the results: _ _********************_ _Testing Time: 5043.24s_ _********************_ _Unexpected Passing Tests (2):_ _lldb-Suite :: functionalities/asan/TestMemoryHistory.py_ _lldb-Suite :: functionalities/asan/TestReportData.py_ _********************_ _Failing Tests (54):_ _Clang :: CXX/modules-ts/basic/basic.link/p2/module.cpp_ _Clang :: Modules/ExtDebugInfo.cpp_ _Clang :: Modules/using-directive-redecl.cpp_ _Clang :: Modules/using-directive.cpp_ _Clang :: PCH/chain-late-anonymous-namespace.cpp_ _Clang :: PCH/cxx-namespaces.cpp_ _Clang :: PCH/namespaces.cpp_ _LLDB :: ExecControl/StopHook/stop-hook-threads.test_ _LeakSanitizer-AddressSanitizer-x8664 :: TestCases/Linux/usetlsdynamic.cc_ _LeakSanitizer-Standalone-x8664 :: TestCases/Linux/usetlsdynamic.cc_ _MemorySanitizer-X8664 :: dtlstest.c_ _MemorySanitizer-lld-X8664 :: dtlstest.c_ _lldb-Suite :: functionalities/register/registercommand/TestRegisters.py_ _lldb-Suite :: tools/lldb-server/TestGdbRemoteRegisterState.py_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestBorrowedReferences_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestDictionaryResolutionWithDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestExtractingUInt64ThroughStructuredData_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestGlobalNameResolutionNoDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestGlobalNameResolutionWithDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestInstanceNameResolutionNoDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestModuleNameResolutionNoDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestObjectAttributes_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestOwnedReferences_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonByteArray_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonBytes_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonCallableCheck_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonCallableInvoke_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonDictionaryManipulation_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonDictionaryToStructuredDictionary_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonDictionaryValueEquality_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonFile_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonInteger_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonIntegerToStr_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonIntegerToStructuredInteger_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonListManipulation_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonListToStructuredList_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonListValueEquality_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonString_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonStringToStr_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonStringToStructuredString_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonTupleInitializerList_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonTupleInitializerList2_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonTupleSize_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonTupleToStructuredList_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestPythonTupleValues_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestResetting_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonDataObjectsTest.TestTypeNameResolutionNoDot_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestAcquisitionSemantics_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestAutoRestoreChanged_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestAutoRestoreSemantics_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestDiscardSemantics_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestExceptionStateChecking_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestManualRestoreSemantics_ _lldb-Unit :: ScriptInterpreter/Python/./ScriptInterpreterPythonTests/PythonExceptionStateTest.TestResetSemantics_ _Expected Passes : 57489_ _Expected Failures : 276_ _Unsupported Tests : 1883_ _Unexpected Passes : 2_ _Unexpected Failures: 54_ _14 warning(s) in tests._ _FAILED: CMakeFiles/check-all_ _ I immediately ran it again and saw one new unexpected fail: _ _lldb-Suite :: tools/lldb-mi/syntax/TestMiSyntax.py_ _ and one new unresolved test: _ _lldb-Suite :: tools/lldb-vscode/breakpoint/TestVSCodesetBreakpoints.py_ _ On the second run but not the first, it hung all night long waiting for TestVSCodesetBreakpoints.py to terminate. I killed dotest.py to get the final results. I currently clone <https://github.com/llvm-project/llvm-project-20170507>. I configure with BUILDSHAREDLIBS=true and -DLLVMENABLEPROJECTS='clang;openmp;libcxx;libcxxabi;lldb;compiler-rt;lld;polly', among other options. I have to run check-all with LDLIBRARYPATH pointing at my build's lib directory, or there are many more LLDB failures. I believe that's not true for most test suites. I'm building and testing under Ubuntu 18.04.1. Hope that helps. I'm happy to provide more details. Just tell me where you'd like to start. Thanks. Joel

On Wed, Jan 2, 2019 at 5:51 PM Kuba Mracek <mracek at apple.com> wrote: +Fred, +me

For LLDB tests: I believe this got much much better recently. Are you still seeing flaky LLDB tests? Any details you can share? For sanitizer tests: I'm very much interesting in removing flakiness as well. Any specific tests you see as flaky? Kuba

On Jan 2, 2019, at 2:05 PM, Joel E. Denny via llvm-dev <llvm-dev at lists.llvm.org> wrote:

Hi David, Chandler, I see lldb tests hang often, and then I kill the dotest process. I'd like to stop running check-all too, but I feel it's important when I modify FileCheck. The flakiness that Chandler mentioned makes it time-consuming to verify test results. Joel

On Wed, Jan 2, 2019 at 4:41 PM Chandler Carruth via llvm-dev <llvm-dev at lists.llvm.org> wrote: What you're seeing is just the fact that lit is waiting on subprocesses (select is waiting on the pipes i suspect).

Anyways, you'll need to dig into what it is waiting on, and what that process is doing that is stuck to make progress. I've not seen anything like this, but I basically never run check-all these days because LLDB and sanitizer tests are too flaky. =[ I've not been able to interest anyone in fixing this either sadly.

On Wed, Jan 2, 2019 at 10:09 AM David Greene via llvm-dev <llvm-dev at lists.llvm.org> wrote: Hi,

From time to time, I see check-all hang during running of lit tests. The hang always happens at the > 90% completion stage and I'm pretty sure all tests have been run and check-all is just waiting for lit/python to exit. I see a single python processing running, taking very little CPU time. An strace of that process shows this: select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 32168}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 4000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 8000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 16000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 32000}) = 0 (Timeout) futex(0x3bcc8c0, FUTEXWAKEPRIVATE, 1) = 1 futex(0x3bcc8c0, FUTEXWAITBITSETPRIVATE|FUTEXCLOCKREALTIME, 0, NULL, ffffffff) = 0 futex(0x3bcc8c0, FUTEXWAITBITSETPRIVATE|FUTEXCLOCKREALTIME, 0, NULL, ffffffff) = -1 EAGAIN (Resourc e temporarily unavailable) futex(0x3bcc8c0, FUTEXWAKEPRIVATE, 1) = 1 select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) futex(0x3bcc8c0, FUTEXWAITBITSETPRIVATE|FUTEXCLOCKREALTIME, 0, NULL, ffffffff) = -1 EAGAIN (Resourc e temporarily unavailable) futex(0x3bcc8c0, FUTEXWAKEPRIVATE, 1) = 1 futex(0x3bcc8c0, FUTEXWAKEPRIVATE, 1) = 1 select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) select(0, NULL, NULL, NULL, {0, 50000}) = 0 (Timeout) It appears that python is waiting for some I/O or something which never appears. Has anyone else seen this before? Any ideas of what is going on or how to fix it? -David

LLVM Developers mailing list llvm-dev at lists.llvm.org http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev

LLVM Developers mailing list llvm-dev at lists.llvm.org http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev

LLVM Developers mailing list llvm-dev at lists.llvm.org http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev

LLVM Developers mailing list llvm-dev at lists.llvm.org http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20190103/c366c1b4/attachment.html>

More information about the llvm-dev mailing list