Dispatch Router crashes with memory corruption error
See original GitHub issueTesting with 1000 devices sending telemetry messages with a target throughput over all devices of 200 messages per second, we have noticed that the dispatch router crashed multiple times with the following error:
*** Error in `/sbin/qdrouterd’: malloc(): memory corruption: 0x00007f135c274310 *** ======= Backtrace: ========= /lib64/libc.so.6(+0x791eb)[0x7f1374ee61eb] /lib64/libc.so.6(+0x8431e)[0x7f1374ef131e] /lib64/libc.so.6(+0x84c8e)[0x7f1374ef1c8e] /lib64/libc.so.6(posix_memalign+0x11d)[0x7f1374ef5fbd] /usr/lib/qpid-dispatch/libqpid-dispatch.so(sys_mutex+0x21)[0x7f1375484601] /usr/lib/qpid-dispatch/libqpid-dispatch.so(qd_message+0x116)[0x7f137547d946]
The router has restarted itself and crashed again after a while. The result was that a lot of messages being sent were lost.
Version of EnMasse in the test was 0.15.3.
Version of the router as per the log file is:
2018-01-08 12:14:58.792885 +0000 ROUTER (info) Version: 1.0.0
Complete log file attached.
Issue Analytics
- State:
- Created 6 years ago
- Comments:7 (4 by maintainers)
@lulf I have not seen this since. So I would say we can close it and open new one if it occurs again.
@chapitos This still an issue or can we close this?