Message import stops

Describe the Bug After a while (days to weeks) Enigma stops importing new FTN messages from the ftn_in folder. A restart of Enigma will begin message import again and the folder will clear. I’m running enigma inside an alpine docker image.

ftn_in directory listing pi@pi-kub0:/local/sbbs/mail/ftn_in $ ls -lh total 3.1M -rw-r–r-- 1 root root 727 Nov 26 05:33 0000ffc5.th0 -rw-r–r-- 1 root root 831 Nov 26 05:35 0000ffc5.th1 -rw-r–r-- 1 root root 1.2K Nov 26 06:25 0000ffc5.th2 -rw-r–r-- 1 root root 2.3K Nov 26 06:33 0000ffc5.th3 -rw-r–r-- 1 root root 856 Nov 26 06:52 0000ffc5.th4 -rw-r–r-- 1 root root 856 Nov 26 06:56 0000ffc5.th5 -rw-r–r-- 1 root root 856 Nov 26 07:13 0000ffc5.th6 -rw-r–r-- 1 root root 1.2K Nov 26 07:18 0000ffc5.th7 -rw-r–r-- 1 root root 1.6K Nov 26 07:28 0000ffc5.th8 -rw-r–r-- 1 root root 865 Nov 26 08:04 0000ffc5.th9 -rw-r–r-- 1 root root 863 Nov 26 08:08 0000ffc5.tha -rw-r–r-- 1 root root 880 Nov 26 08:09 0000ffc5.thb -rw-r–r-- 1 root root 857 Nov 26 08:35 0000ffc5.thc -rw-r–r-- 1 root root 858 Nov 26 08:57 0000ffc5.thd -rw-r–r-- 1 root root 1.4K Nov 26 01:33 0000ffc5.we7 -rw-r–r-- 1 root root 1.3K Nov 26 01:48 0000ffc5.we8 -rw-r–r-- 1 root root 1.4K Nov 26 02:20 0000ffc5.we9 -rw-r–r-- 1 root root 814 Nov 26 03:00 0000ffc5.wea -rw-r–r-- 1 root root 1.4K Nov 26 03:01 0000ffc5.web -rw-r–r-- 1 root root 1.1K Nov 26 03:18 0000ffc5.wec -rw-r–r-- 1 root root 1.4K Nov 26 03:33 0000ffc5.wed -rw-r–r-- 1 root root 933 Nov 26 04:16 0000ffc5.wee -rw-r–r-- 1 root root 986 Nov 26 04:22 0000ffc5.wef -rw-r–r-- 1 root root 1.2K Nov 26 04:30 0000ffc5.weg -rw-r–r-- 1 root root 2.7K Nov 26 01:15 TBBSW32.tic -rw-r–r-- 1 root root 3.0M Nov 26 01:12 TBBSW32.ZIP -rw-r–r-- 1 root root 0 Nov 26 08:57 ‘toss!.now’

last log entry relating to message import (full log is attached) enigma-bbs.log

{“name”:“ENiGMA½ BBS”,“hostname”:“sbbs-enigma-9b59f6f79-vzd6m”,“pid”:19,“level”:20,“tic”:“/mail/ftn_in/TBBSSRC.tic”,“file”:“TBBSSRC.ZIP”,“msg”:“Processing TIC file”,“time”:“2020-11-26T01:25:48.900Z”,“v”:0} {“name”:“ENiGMA½ BBS”,“hostname”:“sbbs-enigma-9b59f6f79-vzd6m”,“pid”:19,“level”:30,“tic”:“/mail/ftn_in/TBBSSRC.tic”,“file”:“/mail/ftn_in/TBBSSRC.ZIP”,“area”:“msgNetworks”,“msg”:“TIC imported successfully”,“time”:“2020-11-26T01:25:49.284Z”,“v”:0} {“name”:“ENiGMA½ BBS”,“hostname”:“sbbs-enigma-9b59f6f79-vzd6m”,“pid”:19,“level”:20,“tic”:“/mail/ftn_in/TBBSW32.tic”,“file”:“TBBSW32.ZIP”,“msg”:“Processing TIC file”,“time”:“2020-11-26T01:25:49.287Z”,“v”:0} pi@pi-kub0:/data/sbbs/logs $ cat enigma-bbs.log | grep ftn_in

Inside the running container I see what could be a stuck unzip process bash-5.0# ps -A PID USER TIME COMMAND 1 root 10:11 node /usr/local/bin/pm2-docker ./main.js 19 root 28:01 node /enigma-bbs/main.js 613 root 0:00 [unzip] 614 root 0:00 /bin/bash 624 root 0:00 ps -A

Environment

• [ Y] I am using Node.js v12.x LTS or higher
• [ Y] npm install or yarn reports success
• Actual Node.js version (node --version): v12.19.0
• Operating system (uname -a on *nix systems): Linux sbbs-enigma-9b59f6f79-vzd6m 5.4.72-v7l+ #1356 SMP Thu Oct 22 13:57:51 BST 2020 armv7l Linux
• Revision (git rev-parse --short HEAD):8aa878a
• Any additional relevant information about your setup: running on k3s (alpine based image https://github.com/fransking/docker-enigma-bbs/blob/master/Dockerfile)

[fransking]

Thanks a lot for looking into this. I’ve re-built my images to the latest source using arm32v7/node:14-alpine as a base, added the -y arg to my config and left the trap in place. Now we wait 😃

[fransking]

Trap is working inside the container. Just have to wait for the issue to occur now. Might take a few days.

Sample output from a successful import. First line is Enigma’s command:

7za e -o/tmp/enigftnimport-201d90d866c64uD7LYw1Ug2HiJEW /mail/ftn_in/0000ffc5.mod

7-Zip (a) [32] 16.02 : Copyright © 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,32 bits,4 CPUs LE)

Scanning the drive for archives: 1 file, 896 bytes (1 KiB)

Extracting archive: /mail/ftn_in/0000ffc5.mod

Path = /mail/ftn_in/0000ffc5.mod Type = zip Physical Size = 896

Everything is Ok

Size: 1255 Compressed: 896