Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[xray] Test failure in stress_tests.py::test_multiple_recursive.

See original GitHub issue

The following test fails sometimes

RAY_USE_XRAY=1 python -m pytest -v -s test/stress_tests.py::test_multiple_recursive[4]

It looks like the relevant failure is

/home/ubuntu/ray/build/external/arrow/src/arrow_ep/cpp/src/plasma/client.cc:451:  Check failed: object_entry->second->is_sealed Plasma client called get on an unsealed object that it created
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet[0x479e1e]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN5arrow4util8ArrowLogD1Ev+0xdd)[0x56d80d]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet[0x549430]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN6plasma12PlasmaClient3GetEPKNS_8UniqueIDEllPNS_12ObjectBufferE+0x44)[0x54adf4]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN3ray16ObjectBufferPool8GetChunkERKNS_8UniqueIDEmmm+0x1df)[0x5297ff]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN3ray13ObjectManager17SendObjectHeadersERKNS_8UniqueIDEmmmRSt10shared_ptrINS_16SenderConnectionEE+0x58)[0x4dd2c8]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN3ray13ObjectManager17ExecuteSendObjectERKNS_8UniqueIDES3_mmmRKNS_20RemoteConnectionInfoE+0x184)[0x4df2f4]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet[0x4df71b]
/home/ubuntu/ray/python/ray/core/src/ray/raylet/raylet(_ZN3ray13ObjectManager14RunSendServiceEv+0x458)[0x4d8f08]
/usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xb8c80)[0x7f0892accc80]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7f0892d9d6ba]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f089223241d]
*** Aborted at 1539557988 (unix time) try "date -d @1539557988" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e80000270c) received by PID 9996 (TID 0x7f089212a700) from PID 9996; stack trace: ***
    @     0x7f0892da7390 (unknown)
    @     0x7f0892160428 gsignal
    @     0x7f089216202a abort
    @           0x56d812 arrow::util::ArrowLog::~ArrowLog()
    @           0x549430 plasma::PlasmaClient::Impl::GetBuffers()
    @           0x54adf4 plasma::PlasmaClient::Get()
    @           0x5297ff ray::ObjectBufferPool::GetChunk()
    @           0x4dd2c8 ray::ObjectManager::SendObjectHeaders()
    @           0x4df2f4 ray::ObjectManager::ExecuteSendObject()
    @           0x4df71b _ZN5boost4asio6detail18completion_handlerIZZN3ray13ObjectManager4PushERKNS3_8UniqueIDES7_ENKUlRKNS3_20RemoteConnectionInfoEE0_clESA_EUlvE_E11do_completeEPNS1_15task_io_serviceEPNS1_25task_io_service_operationERKNS_6system10error_codeEm
    @           0x4d8f08 ray::ObjectManager::RunSendService()
    @     0x7f0892accc80 (unknown)
    @     0x7f0892d9d6ba start_thread
    @     0x7f089223241d clone
    @                0x0 (unknown)