Visualizer displays wrong info if previous tasks failed
See original GitHub issueDescription
If I deploy a stack that fails or is rejected, Visualizer displays node labels as [object Object] and service names as “undefined”. (See screen shot.)
If I run docker stack ps my-service
I see:
DESIRED STATE CURRENT STATE ERROR
Running Failed 19 minutes ago "starting container failed: OC…"
Because the job had failed, I had also run docker stack rm my-service
.
I suspect Visualizer is seeing these old failed tasks rather than filtering to only ones whose Current State is Running. Note the Desired state is Running (even though the actual Current State is failed), so maybe Visualizer is looking at that by mistake?
Steps to reproduce the issue, if relevant:
- Somehow deploy a stack that is rejected or failed. (Sorry, don’t know how to force this on purpose.)
- Observe results in Visualizer.
Describe the results you received:
Describe the results you expected: I expected Visualizer to continue displaying data correctly as it normally does.
Additional information you deem important (e.g. issue happens only occasionally):
Output of docker version
:
Client:
Version: 18.05.0-ce
API version: 1.37
Go version: go1.9.5
Git commit: f150324
Built: Wed May 9 22:16:13 2018
OS/Arch: linux/amd64
Experimental: false
Orchestrator: swarm
Server:
Engine:
Version: 18.05.0-ce
API version: 1.37 (minimum version 1.12)
Go version: go1.9.5
Git commit: f150324
Built: Wed May 9 22:14:23 2018
OS/Arch: linux/amd64
Experimental: false
Output of docker info
:
Containers: 14
Running: 2
Paused: 0
Stopped: 12
Images: 596
Server Version: 18.05.0-ce
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 601
Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: active
NodeID: 3qlfxy2gdse810z07h13f8jdu
Is Manager: true
ClusterID: d7kfhfklhe93g59p0l1utgoy1
Managers: 3
Nodes: 9
Orchestration:
Task History Retention Limit: 1
Raft:
Snapshot Interval: 10000
Number of Old Snapshots to Retain: 0
Heartbeat Tick: 1
Election Tick: 10
Dispatcher:
Heartbeat Period: 5 seconds
CA Configuration:
Expiry Duration: 3 months
Force Rotate: 0
Autolock Managers: false
Root Rotation In Progress: false
Node Address: 198.199.98.120
Manager Addresses:
159.65.195.193:2377
198.199.98.120:2377
209.97.152.211:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 773c489c9c1b21a6d78b5c538cd395416ec50f88
runc version: 4fc53a81fb7c994640722ac585fa9ca548971871
init version: 949e6fa
Security Options:
apparmor
seccomp
Profile: default
Kernel Version: 4.15.0-23-generic
Operating System: Ubuntu 18.04 LTS
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 985.5MiB
Name: m7-sf-1
ID: MTL3:66XA:Z2ZR:TMRA:HVX4:NNAQ:JGQI:FNFQ:D4TT:K6RE:J4KM:3Q4X
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
provider=digitalocean
Experimental: false
Insecure Registries:
m7.code1.io:5000
127.0.0.0/8
Live Restore Enabled: false
WARNING: No swap limit support
Additional environment details (AWS, Docker for Mac, Docker for Windows, VirtualBox, physical, etc.): Digital Ocean cluster
Issue Analytics
- State:
- Created 5 years ago
- Comments:6
Top GitHub Comments
You can also resolve the issue by restarting the docker service. In Linux I ran the following and once docker restarts the visualizer is fixed as well.
sudo service docker restart
Incidentally, I was able to “recover” from this by one by one doing
docker node demote xxx
thendocker node promote xxx
for each of the three swarm managers.The weird thing in this is even though I had done
docker stack rm my-service
, I could still see the failed tasks when I randocker stack ps my-service
. Normally when you remove a stack, you getnothing found in stack: my-service
.Anyway, whether this is a docker bug or expected somehow, Visualizer does not handle the condition well.