question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims

See original GitHub issue

Summary

my chectl version chectl/0.0.20220801-next.24265f6 darwin-x64 node-v16.13.2 i installed eclipse-che using below command

chectl server:deploy --che-operator-cr-patch-yaml=/Users/divine/Documents/office_tasks/TAP-4540/terraformCheJune17/eclipseche_yaml/che-operator-cr-patch.yaml --platform=k8s --installer=operator --debug --k8spoderrorrechecktimeout=1500000 --domain=eclipseche-dchelladurai-chejune15.calatrava.vmware.com --k8spodreadytimeout=1500000

i just logged-in into eclipse-che dashboard and cloned 1 workspace.

below are my pv,pvc,storageclass

dchelladura-a01:vtapbotservice divine$ kubectl get pv,pvc,storageclass -n divine-chelladurai-che-pmjg9u
NAME                                                        CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM                                              STORAGECLASS                            REASON   AGE
persistentvolume/pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35   10Gi       RWO            Delete           Bound    divine-chelladurai-che-pmjg9u/claim-devworkspace   vmc-workload-storage-policy-cluster-1            6m4s
persistentvolume/pvc-d5892021-9ea0-4125-8cce-5ed82bcf7899   10Gi       RWO            Delete           Bound    d-sindhuja-che-a6q94i/claim-devworkspace           vmc-workload-storage-policy-cluster-1            3h22m
persistentvolume/pvc-e01098d1-e183-4d44-ba9c-d1086de34636   3Gi        RWO            Delete           Bound    default/task-pv-claim                              vmc-workload-storage-policy-cluster-1            17d

NAME                                       STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                            AGE
persistentvolumeclaim/claim-devworkspace   Bound    pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35   10Gi       RWO            vmc-workload-storage-policy-cluster-1   6m6s

NAME                                                                          PROVISIONER              RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
storageclass.storage.k8s.io/vmc-workload-storage-policy-cluster-1 (default)   csi.vsphere.vmware.com   Delete          Immediate           true                   51d
dchelladura-a01:vtapbotservice divine$ 


i’m frequently receive this error. i had to wait for couple of hours for this to goaway. i dont know what is the reason for this error

dchelladura-a01:vtapbotservice divine$ kubectl get events -w -n divine-chelladurai-che-pmjg9u
LAST SEEN   TYPE      REASON                   OBJECT                                            MESSAGE
91s         Normal    ExternalProvisioning     persistentvolumeclaim/claim-devworkspace          waiting for a volume to be created, either by external provisioner "csi.vsphere.vmware.com" or manually created by system administrator
91s         Normal    Provisioning             persistentvolumeclaim/claim-devworkspace          External provisioner is provisioning volume for claim "divine-chelladurai-che-pmjg9u/claim-devworkspace"
90s         Normal    ProvisioningSucceeded    persistentvolumeclaim/claim-devworkspace          Successfully provisioned volume pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35
29s         Normal    Scheduled                pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-57c6b44b8d-drw79 to tkc-workers-wnnlk-b55cc6bdd-d6767
28s         Normal    SuccessfulAttachVolume   pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
20s         Normal    Pulling                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
19s         Normal    Pulled                   pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 496.608681ms
19s         Normal    Created                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Created container remote-runtime-injector
19s         Normal    Started                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Started container remote-runtime-injector
18s         Normal    Pulling                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Pulling image "quay.io/devfile/project-clone:v0.15.2"
18s         Normal    Pulled                   pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 346.570157ms
18s         Normal    Created                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Created container project-clone
18s         Normal    Started                  pod/workspace7722130dbd9049ee-57c6b44b8d-drw79    Started container project-clone
29s         Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-57c6b44b8d   Created pod: workspace7722130dbd9049ee-57c6b44b8d-drw79
14s         Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-57c6b44b8d   Deleted pod: workspace7722130dbd9049ee-57c6b44b8d-drw79
91s         Warning   FailedScheduling         pod/workspace7722130dbd9049ee-5f5fbbc678-khd9s    0/4 nodes are available: 4 pod has unbound immediate PersistentVolumeClaims.
91s         Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-khd9s
90s         Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-khd9s
91s         Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
90s         Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
29s         Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-57c6b44b8d to 1
14s         Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-57c6b44b8d to 0
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-n7kh7 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-n7kh7
0s          Normal    SuccessfulAttachVolume   pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 330.553683ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Created container remote-runtime-injector
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Started container remote-runtime-injector
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 345.867809ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Created container project-clone
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-n7kh7    Started container project-clone
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-n7kh7
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-4jrsb
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-4jrsb to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-4jrsb
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-t92gv
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-t92gv to tkc-workers-wnnlk-b55cc6bdd-7k767
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb    Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb    Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 472.644726ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb    Created container remote-runtime-injector
0s          Warning   Failed                   pod/workspace7722130dbd9049ee-5f5fbbc678-4jrsb    Error: sandbox container "eb89576a82303e752f180c5f5d394d3a3833da65036b5c36e288c0440c724c97" is not running
0s          Normal    SuccessfulAttachVolume   pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 340.879788ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Created container remote-runtime-injector
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Started container remote-runtime-injector
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 674.508557ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Created container project-clone
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-t92gv    Started container project-clone
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-t92gv
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-gbrz5
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-gbrz5 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s          Normal    SuccessfulAttachVolume   pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Pulling image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Successfully pulled image "quay.io/eclipse/che-theia-endpoint-runtime-binary:next" in 454.743658ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Created container remote-runtime-injector
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Started container remote-runtime-injector
0s          Normal    Pulling                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Pulling image "quay.io/devfile/project-clone:v0.15.2"
0s          Normal    Pulled                   pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Successfully pulled image "quay.io/devfile/project-clone:v0.15.2" in 344.960292ms
0s          Normal    Created                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Created container project-clone
0s          Normal    Started                  pod/workspace7722130dbd9049ee-5f5fbbc678-gbrz5    Started container project-clone
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-gbrz5
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-zsss9
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-zsss9 to tkc-workers-wnnlk-b55cc6bdd-7k767
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9    Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-zsss9
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-ztjlb
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-ztjlb to tkc-workers-wnnlk-b55cc6bdd-h75s7
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb    Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-ztjlb
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-94nwf
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-94nwf to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    SuccessfulAttachVolume   pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb    AttachVolume.Attach succeeded for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35"
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf    Multi-Attach error for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" Volume is already exclusively attached to one node and can't be attached to another
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-94nwf
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Created pod: workspace7722130dbd9049ee-5f5fbbc678-lszjj
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-lszjj    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-lszjj to tkc-workers-wnnlk-b55cc6bdd-h75s7
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-lszjj
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-t5k5j
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-t5k5j    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-t5k5j to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-t5k5j
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-brt29
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-brt29    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-brt29 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-brt29
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled up replica set workspace7722130dbd9049ee-5f5fbbc678 to 1
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-dzz9r
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-dzz9r    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-dzz9r to tkc-workers-wnnlk-b55cc6bdd-7k767
0s          Normal    ScalingReplicaSet        deployment/workspace7722130dbd9049ee              Scaled down replica set workspace7722130dbd9049ee-5f5fbbc678 to 0
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-dzz9r
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Created pod: workspace7722130dbd9049ee-5f5fbbc678-pj97z
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-pj97z to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z    MountVolume.SetUp failed for volume "automount-secret-che-server-cert" : failed to sync secret cache: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z    MountVolume.SetUp failed for volume "automount-configmap-che-trusted-ca-certs" : failed to sync configmap cache: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z    MountVolume.SetUp failed for volume "che-gateway" : failed to sync configmap cache: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-zsss9    Unable to attach or mount volumes: unmounted volumes=[claim-devworkspace automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert remote-endpoint automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-secret-user-profile che-gateway automount-configmap-che-trusted-ca-certs kube-api-access-jjqsr], unattached volumes=[claim-devworkspace automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert remote-endpoint automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-secret-user-profile che-gateway automount-configmap-che-trusted-ca-certs kube-api-access-jjqsr]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-ztjlb    Unable to attach or mount volumes: unmounted volumes=[kube-api-access-zr8xs automount-secret-user-profile workspace-metadata claim-devworkspace remote-endpoint automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs che-gateway automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert], unattached volumes=[kube-api-access-zr8xs automount-secret-user-profile workspace-metadata claim-devworkspace remote-endpoint automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs che-gateway automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert]: timed out waiting for the condition
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-5f5fbbc678   (combined from similar events): Deleted pod: workspace7722130dbd9049ee-5f5fbbc678-pj97z
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-5f5fbbc678-s9r62 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf    Unable to attach or mount volumes: unmounted volumes=[workspace-metadata automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-qdc79 remote-endpoint automount-configmap-che-trusted-ca-certs che-gateway automount-secret-che-server-cert claim-devworkspace], unattached volumes=[workspace-metadata automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-qdc79 remote-endpoint automount-configmap-che-trusted-ca-certs che-gateway automount-secret-che-server-cert claim-devworkspace]: timed out waiting for the condition
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-94nwf    AttachVolume.Attach failed for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" : Attach timeout for volume df63f994-eaeb-47a8-ac23-0e222cac3b10-80278a68-7f9a-4e24-83b5-ff4fdf993a35
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-lszjj    Unable to attach or mount volumes: unmounted volumes=[automount-secret-user-profile kube-api-access-m5xcx claim-devworkspace automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-configmap-devworkspace-gitconfig remote-endpoint workspace-metadata che-gateway automount-secret-devworkspace-merged-git-credentials], unattached volumes=[automount-secret-user-profile kube-api-access-m5xcx claim-devworkspace automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-configmap-devworkspace-gitconfig remote-endpoint workspace-metadata che-gateway automount-secret-devworkspace-merged-git-credentials]: timed out waiting for the condition
0s          Normal    SuccessfulCreate         replicaset/workspace7722130dbd9049ee-57c6b44b8d   Created pod: workspace7722130dbd9049ee-57c6b44b8d-tkq95
0s          Normal    Scheduled                pod/workspace7722130dbd9049ee-57c6b44b8d-tkq95    Successfully assigned divine-chelladurai-che-pmjg9u/workspace7722130dbd9049ee-57c6b44b8d-tkq95 to tkc-workers-wnnlk-b55cc6bdd-d6767
0s          Normal    SuccessfulDelete         replicaset/workspace7722130dbd9049ee-57c6b44b8d   Deleted pod: workspace7722130dbd9049ee-57c6b44b8d-tkq95
0s          Warning   FailedAttachVolume       pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62    AttachVolume.Attach failed for volume "pvc-80278a68-7f9a-4e24-83b5-ff4fdf993a35" : rpc error: code = Aborted desc = pending
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-t5k5j    Unable to attach or mount volumes: unmounted volumes=[kube-api-access-bpt4f che-gateway claim-devworkspace automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-configmap-che-trusted-ca-certs automount-secret-user-profile remote-endpoint automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert], unattached volumes=[kube-api-access-bpt4f che-gateway claim-devworkspace automount-secret-devworkspace-merged-git-credentials workspace-metadata automount-configmap-che-trusted-ca-certs automount-secret-user-profile remote-endpoint automount-configmap-devworkspace-gitconfig automount-secret-che-server-cert]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-brt29    Unable to attach or mount volumes: unmounted volumes=[automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-secret-user-profile kube-api-access-496j7 che-gateway automount-configmap-devworkspace-gitconfig workspace-metadata claim-devworkspace automount-secret-devworkspace-merged-git-credentials remote-endpoint], unattached volumes=[automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert automount-secret-user-profile kube-api-access-496j7 che-gateway automount-configmap-devworkspace-gitconfig workspace-metadata claim-devworkspace automount-secret-devworkspace-merged-git-credentials remote-endpoint]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-dzz9r    Unable to attach or mount volumes: unmounted volumes=[automount-configmap-devworkspace-gitconfig claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert automount-secret-user-profile che-gateway remote-endpoint kube-api-access-mvgj5 automount-configmap-che-trusted-ca-certs workspace-metadata], unattached volumes=[automount-configmap-devworkspace-gitconfig claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-secret-che-server-cert automount-secret-user-profile che-gateway remote-endpoint kube-api-access-mvgj5 automount-configmap-che-trusted-ca-certs workspace-metadata]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-pj97z    Unable to attach or mount volumes: unmounted volumes=[che-gateway automount-configmap-devworkspace-gitconfig kube-api-access-9cnc9 remote-endpoint automount-secret-user-profile claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert workspace-metadata], unattached volumes=[che-gateway automount-configmap-devworkspace-gitconfig kube-api-access-9cnc9 remote-endpoint automount-secret-user-profile claim-devworkspace automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs automount-secret-che-server-cert workspace-metadata]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-5f5fbbc678-s9r62    Unable to attach or mount volumes: unmounted volumes=[automount-secret-che-server-cert workspace-metadata automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-55lhw remote-endpoint automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs che-gateway claim-devworkspace], unattached volumes=[automount-secret-che-server-cert workspace-metadata automount-configmap-devworkspace-gitconfig automount-secret-user-profile kube-api-access-55lhw remote-endpoint automount-secret-devworkspace-merged-git-credentials automount-configmap-che-trusted-ca-certs che-gateway claim-devworkspace]: timed out waiting for the condition
0s          Warning   FailedMount              pod/workspace7722130dbd9049ee-57c6b44b8d-tkq95    Unable to attach or mount volumes: unmounted volumes=[workspace-metadata kube-api-access-hchw5 automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs automount-secret-user-profile automount-secret-che-server-cert claim-devworkspace che-gateway remote-endpoint], unattached volumes=[workspace-metadata kube-api-access-hchw5 automount-secret-devworkspace-merged-git-credentials automount-configmap-devworkspace-gitconfig automount-configmap-che-trusted-ca-certs automount-secret-user-profile automount-secret-che-server-cert claim-devworkspace che-gateway remote-endpoint]: timed out waiting for the condition


image

below is my devfile.yaml. i’m not sure how to analyze the root cause for this issue. please help me out on this.

schemaVersion: 2.1.0
metadata:
  name: cbfsel-repo
projects:
  - name: cbfsel-project
    git:
      checkoutFrom:
        revision: master
      remotes:
        origin: https://gitlab.com/dchelladurai/cbf-sel.git
components:
  - container:
      image: 'artfact-prd/qedocker/eclipseche/customopenjdk8:v10'
      memoryLimit: 4G
    name: javacontainer
commands:
  - exec:
      commandLine: mvn clean package -DskipTests
      component: javacontainer
      group:
        isDefault: true
        kind: build
      label: 'build project using maven'
      workingDir: '${PROJECT_SOURCE}'
    id: mvnpackage

below link has details on how pvc is used by workspace, i’m just confused on why this error appears for my setup. i have pv,pvc and storageclass available in my cluster. please help me to fix this issue https://www.eclipse.org/che/docs/stable/end-user-guide/requesting-persistent-storage-for-workspaces/

Relevant information

No response

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:28 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
tolushacommented, Aug 25, 2022

I am out of ideas. Could you check this please?

kubectl get deployment che-operator -n eclipse-che -o json | jq -r '.spec.template.spec.containers[0].env[] | select(.name=="RELATED_IMAGE_devworkspace_controller")'

kubectl get checluster eclipse-che -n eclipse-che -o="jsonpath={.spec.components.devWorkspace}"

1reaction
tolushacommented, Aug 24, 2022

Could you also check as well kubectl get namespace devworkspace-controller -o jsonpath="{.metadata.annotations}"

Read more comments on GitHub >

github_iconTop Results From Across the Web

pod has unbound immediate PersistentVolumeClaims
PersistentVolumeClaims will remain unbound indefinitely if a matching PersistentVolume does not exist. The PersistentVolume is matched with ...
Read more >
pod has unbound immediate persistentvolumeclaims #237
Hi I am trying to run consul on Kubernetes using the repo. I get the error "pod has unbound immediate persistentvolumeclaims ".
Read more >
Fixing Pod Has Unbound Immediate PersistentVolumeClaims ...
To talk about the volume node affinity conflict error, first let us take an example to understand this Kubernetes cluster setup: You have...
Read more >
Fixing – pod has unbound immediate persistentvolumeclaims ...
To fix this issue you should put the same accessModes in both PV and **PVC ** configurations, so choose accessModes based on your...
Read more >
Viewing the status of the log store - OpenShift Documentation
The following status message indicates that a node has exceeded the ... message: pod has unbound immediate PersistentVolumeClaims (repeated 5 times) reason: ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found