PVC is not cleaned up when workspace is deleted

Describe the bug

Workspace data that are saved on PVC are not deleted when the workspace is stopped and removed. There is also log about that on che-server side: Unable to perform '[rm, -rf, /tmp/job_mount/workspace31s04khmt5qsdxjs]' command for the workspace 'workspace31s04khmt5qsdxjs' cause: 'Failed to evaluate the project name to use for workspace workspace31s04khmt5qsdxjs. The error message was: Workspace with id 'workspace31s04khmt5qsdxjs' doesn't exist'

Che version

• latest 7.5.0
• nightly
• other: please specify

Steps to reproduce

Create workspace (I tried default Java Maven or using factory link) and wait for it to start. Remove workspace. Check PVC claim-che-workspace.

Expected behavior

When the workspace is deleted, there should be no data on a PVC.

Runtime

• kubernetes (include output of kubectl version)

• Openshift (include output of oc version) oc v3.11.0+0cbc58b kubernetes v1.11.0+d4cacc0 features: Basic-Auth GSSAPI Kerberos SPNEGO Server https://api.crw.codereadyqe.com:6443 kubernetes v1.13.4+df9cebc

• minikube (include output of minikube version and kubectl version)

• minishift (include output of minishift version and oc version)

• docker-desktop + K8S (include output of docker version and kubectl version)

• other: (please specify)

Installation method

• chectl chectl server:start --platform openshift -a operator -n katka-che -i eclipse/che-server:7.5.0
• che-operator
• minishift-addon
• I don’t know

Environment

• my computer
  • Windows
  • Linux
  • macOS
• Cloud
  • Amazon
  • Azure
  • GCE
  • other (please specify)
• other: please specify

[skabashnyuk]

One of the logical fixes of that is to backport https://github.com/eclipse/che/pull/15040 to 7.5.X

[benoitf]

changing severity