Error: Too many Cluster redirections. Last error: ReplyError: MOVED for Azure Redis Cluster
See original GitHub issueHi,
We are facing Error: Too many Cluster redirections for most of the operations we are using (hgetall, smembers, get either via Clusterclient or via multi commands) in multi sharded (shard count = 2) azure redis in production. The strange part is that the issue only occurs with Azure Redis Cluster and it works fine for AWS Elastic Cache Cluster. We are on the latest version of ioredis 5.0.5. Below are the debug logs of ioredis:
`
2022-05-24T10:28:52.57+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:52.578Z ioredis:cluster status: [empty] -> wait 2022-05-24T10:28:52.57+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:52.579Z ioredis:cluster status: wait -> connecting 2022-05-24T10:28:52.58+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:52.580Z ioredis:cluster resolved hostname redis-<redacted>.redis.cache.windows.net to IP redis-<redacted>.redis.cache.windows.net 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.335Z ioredis:cluster:connectionPool Reset with [ 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR { 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR host: ‘redis-<redacted>.redis.cache.windows.net’, 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR port: 6380 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR } 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.336Z ioredis:cluster:connectionPool Connecting to redis-<redacted>.redis.cache.windows.net:6380 as master 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.336Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380]: wait -> wait 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.337Z ioredis:cluster getting slot cache from redis-<redacted>.redis.cache.windows.net:6380 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.337Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(refresher))]: wait -> wait 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.338Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(refresher))]: wait -> connecting 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.339Z ioredis:redis queue command[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.33+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.339Z ioredis:cluster:subscriber selected a subscriber redis-<redacted>.redis.cache.windows.net:6380 2022-05-24T10:28:53.34+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.339Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(subscriber))]: wait -> wait 2022-05-24T10:28:53.34+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.340Z ioredis:cluster:subscriber started 2022-05-24T10:28:53.39+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.399Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connecting -> connect 2022-05-24T10:28:53.39+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.399Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> auth([ ‘<redacted>’ ]) 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.400Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connect -> ready 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.400Z ioredis:connection set the connection name [ioredis-cluster(refresher)] 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.400Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> client([ ‘setname’, ‘ioredis-cluster(refresher)’ ]) 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.400Z ioredis:connection send 1 commands in offline queue 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.401Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.405Z ioredis:cluster cluster slots result count: 2 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.405Z ioredis:cluster cluster slots result [0]: slots 8192~16383 served by [ 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15003’, 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15004’, 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15005’ 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.406Z ioredis:cluster cluster slots result [1]: slots 0~8191 served by [ 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15001’, 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’, 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15000’, 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’ 2022-05-24T10:28:53.40+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.419Z ioredis:cluster:connectionPool Reset with [ 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15003, readOnly: false }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15004, readOnly: true }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15005, readOnly: true }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15001, readOnly: false }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15000, readOnly: true }, 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true } 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.419Z ioredis:cluster:connectionPool Disconnect redis-<redacted>.redis.cache.windows.net:6380 because the node does not hold any slot 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.419Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380]: wait -> close 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.419Z ioredis:connection skip reconnecting since the connection is manually closed. 2022-05-24T10:28:53.41+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.419Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380]: close -> end 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:cluster:connectionPool Remove redis-<redacted>.redis.cache.windows.net:6380 from the pool 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15003 as master 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:redis status[<redacted_redis_ip>:15003]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15004 as slave 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:redis status[<redacted_redis_ip>:15004]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15005 as slave 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:redis status[<redacted_redis_ip>:15005]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.420Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15001 as master 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:redis status[<redacted_redis_ip>:15001]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15002 as slave 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:redis status[<redacted_redis_ip>:15002]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:cluster:connectionPool Connecting to <redacted_redis_ip>:15000 as slave 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:redis status[<redacted_redis_ip>:15000]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.421Z ioredis:cluster status: connecting -> connect 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:redis status[<redacted_redis_ip>:15003]: wait -> connecting 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:redis queue command[<redacted_redis_ip>:15003]: 0 -> cluster([ ‘INFO’ ]) 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:cluster:subscriber subscriber has left, selecting a new one… 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(subscriber))]: wait -> close 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:connection skip reconnecting since the connection is manually closed. 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:redis status[redis-<redacted>.redis.cache.windows.net:6380 (ioredis-cluster(subscriber))]: close -> end 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.422Z ioredis:cluster:subscriber selected a subscriber <redacted_redis_ip>:15002 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.423Z ioredis:redis status[<redacted_redis_ip>:15002 (ioredis-cluster(subscriber))]: wait -> wait 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.426Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: ready -> close 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.426Z ioredis:connection skip reconnecting since the connection is manually closed. 2022-05-24T10:28:53.42+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.426Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: close -> end 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.440Z ioredis:redis status[<redacted_redis_ip>:6380]: connecting -> connect 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.440Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> auth([ ‘<redacted>’ ]) 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.441Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> info([]) 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.445Z ioredis:redis status[<redacted_redis_ip>:6380]: connect -> ready 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.445Z ioredis:connection send 1 commands in offline queue 2022-05-24T10:28:53.44+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.445Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> cluster([ ‘INFO’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.450Z ioredis:cluster status: connect -> ready 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.450Z ioredis:cluster send 11 commands in offline queue 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.451Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.451Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.451Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.451Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.452Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.453Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.455Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.455Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.455Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.455Z ioredis:cluster getting slot cache from <redacted_redis_ip>:15001 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.456Z ioredis:redis status[<redacted_redis_ip>:15001 (ioredis-cluster(refresher))]: wait -> wait 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.456Z ioredis:redis status[<redacted_redis_ip>:15001 (ioredis-cluster(refresher))]: wait -> connecting 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.456Z ioredis:redis queue command[<redacted_redis_ip>:15001 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.457Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.459Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.45+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.459Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.460Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.461Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.466Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.466Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.467Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.46+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.468Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.471Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.472Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.473Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.477Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.477Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.477Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.477Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.478Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.47+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.479Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.480Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connecting -> connect 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.480Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> auth([ ‘<redacted>’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.480Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connect -> ready 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.480Z ioredis:connection set the connection name [ioredis-cluster(refresher)] 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.480Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> client([ ‘setname’, ‘ioredis-cluster(refresher)’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:connection send 1 commands in offline queue 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.481Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.482Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.483Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.484Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.485Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.485Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.485Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.486Z ioredis:cluster cluster slots result count: 2 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.486Z ioredis:cluster cluster slots result [0]: slots 0~8191 served by [ 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15001’, 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’, 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15000’, 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’ 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.486Z ioredis:cluster cluster slots result [1]: slots 8192~16383 served by [ 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15003’, 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15004’, 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15005’ 2022-05-24T10:28:53.48+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.499Z ioredis:cluster:connectionPool Reset with [ 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15001, readOnly: false }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15000, readOnly: true }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15003, readOnly: false }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15004, readOnly: true }, 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15005, readOnly: true } 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.499Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.499Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.49+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.499Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.500Z ioredis:cluster getting slot cache from <redacted_redis_ip>:15002 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.500Z ioredis:redis status[<redacted_redis_ip>:15002 (ioredis-cluster(refresher))]: wait -> wait 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.500Z ioredis:redis status[<redacted_redis_ip>:15002 (ioredis-cluster(refresher))]: wait -> connecting 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.500Z ioredis:redis queue command[<redacted_redis_ip>:15002 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.501Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.501Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.501Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.501Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.502Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: ready -> close 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:connection skip reconnecting since the connection is manually closed. 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: close -> end 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.503Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.504Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.504Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.504Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.504Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.504Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.506Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.507Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.50+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.508Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.513Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.514Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.515Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.515Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.515Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.515Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.517Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.517Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.517Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.517Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.517Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connecting -> connect 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> auth([ ‘<redacted>’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:redis status[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: connect -> ready 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:connection set the connection name [ioredis-cluster(refresher)] 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> client([ ‘setname’, ‘ioredis-cluster(refresher)’ ]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.518Z ioredis:connection set the connection to readonly mode 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.519Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> readonly([]) 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.519Z ioredis:connection send 1 commands in offline queue 2022-05-24T10:28:53.51+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.519Z ioredis:redis write command[<redacted_redis_ip>:6380 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.520Z ioredis:cluster cluster slots result count: 2 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.520Z ioredis:cluster cluster slots result [0]: slots 8192~16383 served by [ 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15003’, 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15004’, 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15005’ 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.520Z ioredis:cluster cluster slots result [1]: slots 0~8191 served by [ 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15001’, 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’, 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15000’, 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ‘<redacted_redis_ip>:15002’ 2022-05-24T10:28:53.52+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.532Z ioredis:cluster:connectionPool Reset with [ 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15003, readOnly: false }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15004, readOnly: true }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15005, readOnly: true }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15001, readOnly: false }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15000, readOnly: true }, 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR { host: ‘<redacted_redis_ip>’, port: 15002, readOnly: true } 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR ] 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.532Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:cluster getting slot cache from <redacted_redis_ip>:15000 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:redis status[<redacted_redis_ip>:15000 (ioredis-cluster(refresher))]: wait -> wait 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:redis status[<redacted_redis_ip>:15000 (ioredis-cluster(refresher))]: wait -> connecting 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:redis queue command[<redacted_redis_ip>:15000 (ioredis-cluster(refresher))]: 0 -> cluster([ ‘SLOTS’ ]) 2022-05-24T10:28:53.53+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.533Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.59+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.598Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.59+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.598Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.59+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.598Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.59+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.598Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_2’ ]) 2022-05-24T10:28:53.59+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.598Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.602Z ioredis:cluster command get is moved to <redacted_redis_ip>:15003 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.602Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> get([ ‘{CONFIG}_REDACTED_KEY_1’ ]) 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.602Z ioredis:cluster refreshing slot caches… (triggered by MOVED error) 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] OUT {“written_at”:“2022-05-24T04:58:53.603Z”,“written_ts”:1653368333603000000,“csn_component”:“-”,“correlation_id”:“-”,“type”:“log”,“logger”:“nodejs-logger”,“layer”:“/Application/utils/redis”,“level”:“error”,“container_id”:“<redacted_container_ip>”,“component_type”:“application”,“component_id”:“<redacted_component_id>”,“component_name”:“<redacted_component_name>”,“component_instance”:-1,“source_instance”:-1,“organization_id”:“<redacted_cf_org_id>”,“organization_name”:“<redacted_cf_org_name>”,“space_id”:“<redacted_cf_space_id>”,“space_name”:“<redacted_cf_space_name>”,“context_id”:“”,“msg”:“Unable to get key {CONFIG}_REDACTED_KEY_1 [Error: Too many Cluster redirections. Last error: ReplyError: MOVED 15581 <redacted_redis_ip>:15003]”} 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.605Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> hgetall([ ‘{CONFIG}_REDACTED_KEY_3’ ])
2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] OUT {“written_at”:“2022-05-24T04:58:53.606Z”,“written_ts”:1653368333606000000,“csn_component”:“-”,“correlation_id”:“-”,“type”:“log”,“logger”:“nodejs-logger”,“layer”:“/Application/utils/redis”,“level”:“error”,“container_id”:“<redacted_container_ip>”,“component_type”:“application”,“component_id”:“<redacted_component_id>”,“component_name”:“<redacted_component_name>”,“component_instance”:-1,“source_instance”:-1,“organization_id”:“<redacted_cf_org_id>”,“organization_name”:“<redacted_cf_org_name>”,“space_id”:“<redacted_cf_space_id>”,“space_name”:“<redacted_cf_space_name>”,“context_id”:“”,“msg”:“Unable to get key {CONFIG}_REDACTED_KEY_2 [Error: Too many Cluster redirections. Last error: ReplyError: MOVED 15581 <redacted_redis_ip>:15003]”} 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] ERR 2022-05-24T04:58:53.607Z ioredis:redis write command[<redacted_redis_ip>:6380]: 0 -> hgetall([ ‘{CONFIG}_REDACTED_KEY_4’ ]) 2022-05-24T10:28:53.60+0530 [APP/PROC/WEB/0] OUT {“written_at”:“2022-05-24T04:58:53.607Z”,“written_ts”:1653368333607000000,“csn_component”:“-”,“correlation_id”:“-”,“type”:“log”,“logger”:“nodejs-logger”,“layer”:“/Application/utils/redis”,“level”:“error”,“container_id”:“<redacted_container_ip>”,“component_type”:“application”,“component_id”:“<redacted_component_id>”,“component_name”:“<redacted_component_name>”,“component_instance”:-1,“source_instance”:-1,“organization_id”:“<redacted_cf_org_id>”,“organization_name”:“<redacted_cf_org_name>”,“space_id”:“<redacted_cf_space_id>”,“space_name”:“<redacted_cf_space_name>”,“context_id”:“”,“msg”:“Unable to get key {CONFIG}_REDACTED_KEY_1 [Error: Too many Cluster redirections. Last error: ReplyError: MOVED 15581 <redacted_redis_ip>:15003]”}
` I couldn’t understand why do we get so many MOVED errors because all of the keys are in same shard using {CONFIG} hash tags. Any pointers to solve this would be helpful.
Thanks, Sathish
Issue Analytics
- State:
- Created a year ago
- Comments:6
Top GitHub Comments
I am also experiencing this issue. ioredis does not appear to be properly managing MOVED ReplyError and resetting the host.
We are now at “5.2.2” and have no further problems.
The only problem we have, if the redis cluster restarts we get MOVED error until we restart our services. Still searching for a reconnect strategy …