0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims
See original GitHub issueSummary
my chectl version chectl/0.0.20220801-next.24265f6 darwin-x64 node-v16.13.2
i installed eclipse-che using below command
chectl server:deploy --che-operator-cr-patch-yaml=/Users/divine/Documents/office_tasks/TAP-4540/terraformCheJune17/eclipseche_yaml/che-operator-cr-patch.yaml --platform=k8s --installer=operator --debug --k8spoderrorrechecktimeout=1500000 --domain=eclipseche-dchelladurai-chejune15.calatrava.vmware.com --k8spodreadytimeout=1500000
i just logged-in into eclipse-che dashboard and cloned 1 workspace.
below are my pv,pvc,storageclass
dchelladura-a01:vtapbotservice divine$ kubectl get pv,pvc,storageclass -n divine-chelladurai-che-pmjg9u
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE
persistentvolume/pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35 10Gi RWO Delete Bound divine-chelladurai-che-pmjg9u/claim-devworkspace vmc-workload-storage-policy-cluster-1 6m4s
persistentvolume/pvc-d5892021-9ea0-4125-8cce-5ed82bcf7899 10Gi RWO Delete Bound d-sindhuja-che-a6q94i/claim-devworkspace vmc-workload-storage-policy-cluster-1 3h22m
persistentvolume/pvc-e01098d1-e183-4d44-ba9c-d1086de34636 3Gi RWO Delete Bound default/task-pv-claim vmc-workload-storage-policy-cluster-1 17d
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
persistentvolumeclaim/claim-devworkspace Bound pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35 10Gi RWO vmc-workload-storage-policy-cluster-1 6m6s
NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
storageclass.storage.k8s.io/vmc-workload-storage-policy-cluster-1 (default) csi.vsphere.vmware.com Delete Immediate true 51d
dchelladura-a01:vtapbotservice divine$
i’m frequently receive this error. i had to wait for couple of hours for this to goaway. i dont know what is the reason for this error
dchelladura-a01:vtapbotservice divine$ kubectl get events -w -n divine-chelladurai-che-pmjg9u
LAST SEEN TYPE REASON OBJECT MESSAGE
91s Normal ExternalProvisioning persistentvolumeclaim/claim-devworkspace waiting for a volume to be created, either by external provisioner "csi.vsphere.vmware.com" or manually created by system administrator
91s Normal Provisioning persistentvolumeclaim/claim-devworkspace External provisioner is provisioning volume for claim "divine-chelladurai-che-pmjg9u/claim-devworkspace"
90s Normal ProvisioningSucceeded persistentvolumeclaim/claim-devworkspace Successfully provisioned volume pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35
29s Normal Scheduled pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-57c6b44b8d-drw79 to tkc-workers-wnnlk-b55cc6bdd-d6767
28s Normal SuccessfulAttachVolume pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
20s Normal Pulling pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
19s Normal Pulled pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 496.608681ms
19s Normal Created pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Created container remote-runtime-injector
19s Normal Started pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Started container remote-runtime-injector
18s Normal Pulling pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Pulling image "quay.io/devfile/project-clone:v0.15.2"
18s Normal Pulled pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 346.570157ms
18s Normal Created pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Created container project-clone
18s Normal Started pod/workspace7722130dbd9049ee-57c6b44b8d-drw79 Started container project-clone
29s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-57c6b44b8d Created pod: workspace7722130dbd9049ee-57c6b44b8d-drw79
14s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-57c6b44b8d Deleted pod: workspace7722130dbd9049ee-57c6b44b8d-drw79
91s Warning FailedScheduling pod/workspace7722130dbd9049ee-5f5fbbc678-khd9s 0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims.
91s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-khd9s
90s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-khd9s
91s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
90s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
29s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-57c6b44b8d to 1
14s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-57c6b44b8d to 0
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-n7kh7
0s Normal SuccessfulAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 330.553683ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Created container remote-runtime-injector
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Started container remote-runtime-injector
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 345.867809ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Created container project-clone
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 Started container project-clone
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-n7kh7
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-4jrsb
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-4jrsb to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-4jrsb
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-t92gv
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-t92gv to tkc-workers-wnnlk-b55cc6bdd-7k767
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 472.644726ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb Created container remote-runtime-injector
0s Warning Failed pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb Error: sandbox container "eb89576a82303e752f180c5f5d394d3a3833da65036b5c36e288c0440c724c97" is not running
0s Normal SuccessfulAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 340.879788ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Created container remote-runtime-injector
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Started container remote-runtime-injector
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 674.508557ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Created container project-clone
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv Started container project-clone
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-t92gv
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-gbrz5
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s Normal SuccessfulAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 454.743658ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Created container remote-runtime-injector
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Started container remote-runtime-injector
0s Normal Pulling pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s Normal Pulled pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 344.960292ms
0s Normal Created pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Created container project-clone
0s Normal Started pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 Started container project-clone
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-gbrz5
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-zsss9
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-zsss9 to tkc-workers-wnnlk-b55cc6bdd-7k767
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9 Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-zsss9
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-ztjlb
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-ztjlb to tkc-workers-wnnlk-b55cc6bdd-h75s7
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-ztjlb
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-94nwf
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-94nwf to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal SuccessfulAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-94nwf
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 Created pod: workspace7722130dbd9049ee-5f5fbbc678-lszjj
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-lszjj Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-lszjj to tkc-workers-wnnlk-b55cc6bdd-h75s7
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-lszjj
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-t5k5j
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-t5k5j Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-t5k5j to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-t5k5j
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-brt29
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-brt29 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-brt29 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-brt29
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-dzz9r
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-dzz9r Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-dzz9r to tkc-workers-wnnlk-b55cc6bdd-7k767
0s Normal ScalingReplicaSet deployment/workspace7722130dbd9049ee Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-dzz9r
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-pj97z
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-pj97z to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z MountVolume.SetUp failed for volume "automount-secret-che-server-cert" : failed to sync secret cache: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z MountVolume.SetUp failed for volume "automount-configmap-che-trusted-ca-certs" : failed to sync configmap cache: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z MountVolume.SetUp failed for volume "che-gateway" : failed to sync configmap cache: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9 Unable to attach or mount volumes: unmounted volumes=[claim-devworkspace automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert remote-endpoint automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-secret-user-profile che-gateway automount-configmap-che-trusted-ca-certs kube-api-access-jjqsr], unattached volumes=[claim-devworkspace automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert remote-endpoint automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-secret-user-profile che-gateway automount-configmap-che-trusted-ca-certs kube-api-access-jjqsr]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb Unable to attach or mount volumes: unmounted volumes=[kube-api-access-zr8xs automount-secret-user-profile workspace-metadata claim-devworkspace remote-endpoint automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs che-gateway automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert], unattached volumes=[kube-api-access-zr8xs automount-secret-user-profile workspace-metadata claim-devworkspace remote-endpoint automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs che-gateway automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert]: timed out waiting for the condition
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-5f5fbbc678 (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-pj97z
0s Normal Scheduled pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-s9r62 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf Unable to attach or mount volumes: unmounted volumes=[workspace-metadata automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-qdc79 remote-endpoint automount-configmap-che-trusted-ca-certs che-gateway automount-secret-che-server-cert claim-devworkspace], unattached volumes=[workspace-metadata automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-qdc79 remote-endpoint automount-configmap-che-trusted-ca-certs che-gateway automount-secret-che-server-cert claim-devworkspace]: timed out waiting for the condition
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf AttachVolume.Attach failed for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" : Attach timeout for volume df63f994-eaeb-47a8-ac23-0e222cac3b10-80278a68-7f9a-4e24-83b5-ff4fdf993a35
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-lszjj Unable to attach or mount volumes: unmounted volumes=[automount-secret-user-profile kube-api-access-m5xcx claim-devworkspace automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-configmap-devworkspace-gitconfig remote-endpoint workspace-metadata che-gateway automount-secret-devworkspace-merged-git-credentials], unattached volumes=[automount-secret-user-profile kube-api-access-m5xcx claim-devworkspace automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-configmap-devworkspace-gitconfig remote-endpoint workspace-metadata che-gateway automount-secret-devworkspace-merged-git-credentials]: timed out waiting for the condition
0s Normal SuccessfulCreate replicaset/workspace7722130dbd9049ee-57c6b44b8d Created pod: workspace7722130dbd9049ee-57c6b44b8d-tkq95
0s Normal Scheduled pod/workspace7722130dbd9049ee-57c6b44b8d-tkq95 Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-57c6b44b8d-tkq95 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s Normal SuccessfulDelete replicaset/workspace7722130dbd9049ee-57c6b44b8d Deleted pod: workspace7722130dbd9049ee-57c6b44b8d-tkq95
0s Warning FailedAttachVolume pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62 AttachVolume.Attach failed for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" : rpc error: code = Aborted desc = pending
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-t5k5j Unable to attach or mount volumes: unmounted volumes=[kube-api-access-bpt4f che-gateway claim-devworkspace automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-configmap-che-trusted-ca-certs automount-secret-user-profile remote-endpoint automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert], unattached volumes=[kube-api-access-bpt4f che-gateway claim-devworkspace automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-configmap-che-trusted-ca-certs automount-secret-user-profile remote-endpoint automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-brt29 Unable to attach or mount volumes: unmounted volumes=[automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-secret-user-profile kube-api-access-496j7 che-gateway automount-configmap-devworkspace-gitconfig workspace-metadata claim-devworkspace automount-secret-devworkspace-merged-git-credentials remote-endpoint], unattached volumes=[automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-secret-user-profile kube-api-access-496j7 che-gateway automount-configmap-devworkspace-gitconfig workspace-metadata claim-devworkspace automount-secret-devworkspace-merged-git-credentials remote-endpoint]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-dzz9r Unable to attach or mount volumes: unmounted volumes=[automount-configmap-devworkspace-gitconfig claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert automount-secret-user-profile che-gateway remote-endpoint kube-api-access-mvgj5 automount-configmap-che-trusted-ca-certs workspace-metadata], unattached volumes=[automount-configmap-devworkspace-gitconfig claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert automount-secret-user-profile che-gateway remote-endpoint kube-api-access-mvgj5 automount-configmap-che-trusted-ca-certs workspace-metadata]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z Unable to attach or mount volumes: unmounted volumes=[che-gateway automount-configmap-devworkspace-gitconfig kube-api-access-9cnc9 remote-endpoint automount-secret-user-profile claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert workspace-metadata], unattached volumes=[che-gateway automount-configmap-devworkspace-gitconfig kube-api-access-9cnc9 remote-endpoint automount-secret-user-profile claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert workspace-metadata]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62 Unable to attach or mount volumes: unmounted volumes=[automount-secret-che-server-cert workspace-metadata automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-55lhw remote-endpoint automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs che-gateway claim-devworkspace], unattached volumes=[automount-secret-che-server-cert workspace-metadata automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-55lhw remote-endpoint automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs che-gateway claim-devworkspace]: timed out waiting for the condition
0s Warning FailedMount pod/workspace7722130dbd9049ee-57c6b44b8d-tkq95 Unable to attach or mount volumes: unmounted volumes=[workspace-metadata kube-api-access-hchw5 automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs automount-secret-user-profile automount-secret-che-server-cert claim-devworkspace che-gateway remote-endpoint], unattached volumes=[workspace-metadata kube-api-access-hchw5 automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs automount-secret-user-profile automount-secret-che-server-cert claim-devworkspace che-gateway remote-endpoint]: timed out waiting for the condition
below is my devfile.yaml. i’m not sure how to analyze the root cause for this issue. please help me out on this.
schemaVersion: 2.1.0
metadata:
name: cbfsel-repo
projects:
- name: cbfsel-project
git:
checkoutFrom:
revision: master
remotes:
origin: https://gitlab.com/dchelladurai/cbf-sel.git
components:
- container:
image: 'artfact-prd/qedocker/eclipseche/customopenjdk8:v10'
memoryLimit: 4G
name: javacontainer
commands:
- exec:
commandLine: mvn clean package -DskipTests
component: javacontainer
group:
isDefault: true
kind: build
label: 'build project using maven'
workingDir: '${PROJECT_SOURCE}'
id: mvnpackage
below link has details on how pvc is used by workspace, i’m just confused on why this error appears for my setup. i have pv,pvc and storageclass available in my cluster. please help me to fix this issue https://www.eclipse.org/che/docs/stable/end-user-guide/requesting-persistent-storage-for-workspaces/
Relevant information
No response
Issue Analytics
- State:
- Created a year ago
- Comments:28 (9 by maintainers)
Top GitHub Comments
I am out of ideas. Could you check this please?
kubectl get deployment che-operator -n eclipse-che -o json | jq -r '.spec.template.spec.containers[0].env[] | select(.name=="RELATED_IMAGE_devworkspace_controller")'
kubectl get checluster eclipse-che -n eclipse-che -o="jsonpath={.spec.components.devWorkspace}"
Could you also check as well
kubectl get namespace devworkspace-controller -o jsonpath="{.metadata.annotations}"