question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. ItΒ collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Che is not accessible after being started by chectl on Kubernetes

See original GitHub issue

Describe the bug

Chectl didn’t enable ingress addon on Kubernetes besides there was Enable minikube ingress addon [completed] in output, and it made Che inaccessible by Che Server URL.

Chectl version

https://github.com/che-incubator/chectl/releases/latest/download/chectl-linux

Steps to reproduce

  1. Install Kubernetes using minikube from scratch:
  export MINIKUBE_WANTUPDATENOTIFICATION=false
  export MINIKUBE_WANTREPORTERRORPROMPT=false
  export MINIKUBE_HOME=$HOME
  export CHANGE_MINIKUBE_NONE_USER=true
  export KUBECONFIG=$HOME/.kube/config
  
  mkdir -p $HOME/.kube $HOME/.minikube
  touch $KUBECONFIG
  
  sudo -E  /usr/local/bin/minikube start  \
      --vm-driver=none \
      --cpus 4 \
      --memory 12288 \
      --extra-config=kubelet.cgroup-driver=systemd
  1. Start Che using chectl:
chectl server:start --k8spodreadytimeout=180000 -t=/mnt/hudson_workspace/workspace/CHE-7-Happy-Path-Tests/deploy/ --listr-renderer=verbose

Expected behavior

Che has been installed and is accessible by Che Server URL.

Actual behavior

Che was not accessible by Che Server URL because ingress addon was not actually enabled:

curl -v http://che-che.10.0.148.224.nip.io
* About to connect() to che-che.10.0.148.224.nip.io port 80 (#0)
*   Trying 10.0.148.224...
* Connection refused
* Failed connect to che-che.10.0.148.224.nip.io:80; Connection refused
* Closing connection 0
curl: (7) Failed connect to che-che.10.0.148.224.nip.io:80; Connection refused

There was no ~/.minikube/config/config.json file with "ingress": true parameter

ls -la ~/.minikube/config
total 4
drwxr-xr-x.  2 hudson hudson    6 Jul 12 12:07 .
drwxrwxr-x. 10 hudson hudson 4096 Jul 12 12:07 ..

There was no nginx-ingress-controller running among the pods:

kubectl get pods --all-namespaces
NAMESPACE     NAME                               READY   STATUS    RESTARTS   AGE
che           che-6d6c8b5fb4-rbnr2               1/1     Running   0          3m36s
kube-system   coredns-fb8b8dccf-75bs8            1/1     Running   0          6m23s
kube-system   coredns-fb8b8dccf-nqr5s            1/1     Running   0          6m23s
kube-system   etcd-minikube                      1/1     Running   0          5m9s
kube-system   kube-addon-manager-minikube        1/1     Running   0          6m33s
kube-system   kube-apiserver-minikube            1/1     Running   0          5m21s
kube-system   kube-controller-manager-minikube   1/1     Running   0          5m34s
kube-system   kube-proxy-pfq2l                   1/1     Running   0          6m23s
kube-system   kube-scheduler-minikube            1/1     Running   0          5m29s
kube-system   storage-provisioner                1/1     Running   0          6m22s
kube-system   tiller-deploy-75456b7758-7v9lj     1/1     Running   0          3m54s

Runtime

  • kubernetes

Client Version: version.Info{Major:β€œ1”, Minor:β€œ14”, GitVersion:β€œv1.14.3”, GitCommit:β€œ5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0”, GitTreeState:β€œclean”, BuildDate:β€œ2019-06-06T01:44:30Z”, GoVersion:β€œgo1.12.5”, Compiler:β€œgc”, Platform:β€œlinux/amd64”}

  • minikube v1.1.1, kubelet v1.14.3

Logs

/usr/local/bin/chectl server:start --k8spodreadytimeout=180000 -t=/mnt/hudson_workspace/workspace/CHE-7-Happy-Path-Tests/deploy/ --listr-renderer=verbose
[12:10:00] ✈️  Minikube preflight checklist [started]
[12:10:00] Verify if kubectl is installed [started]
[12:10:00] Verify if kubectl is installed [completed]
[12:10:00] Verify if minikube is installed [started]
[12:10:00] Verify if minikube is installed [completed]
[12:10:00] Verify if minikube is running [started]
[12:10:00] Verify if minikube is running [completed]
[12:10:00] Start minikube [started]
[12:10:00] Start minikube [skipped]
[12:10:00] β†’ Minikube is already running.
[12:10:00] Verify if minikube ingress addon is enabled [started]
[12:10:00] Verify if minikube ingress addon is enabled [completed]
[12:10:00] Enable minikube ingress addon [started]
[12:10:00] Enable minikube ingress addon [completed]
[12:10:00] Retrieving minikube IP and domain for ingress URLs [started]
[12:10:00] Retrieving minikube IP and domain for ingress URLs...10.0.148.224.nip.io. [title changed]
[12:10:00] Retrieving minikube IP and domain for ingress URLs...10.0.148.224.nip.io. [completed]
[12:10:00] ✈️  Minikube preflight checklist [completed]
[12:10:00] πŸƒβ€  Running Helm to install Che [started]
[12:10:00] Verify if helm is installed [started]
[12:10:00] Verify if helm is installed [completed]
[12:10:00] Create Tiller Role Binding [started]
[12:10:01] Create Tiller Role Binding...done. [title changed]
[12:10:01] Create Tiller Role Binding...done. [completed]
[12:10:01] Create Tiller Service Account [started]
[12:10:01] Create Tiller Service Account...done. [title changed]
[12:10:01] Create Tiller Service Account...done. [completed]
[12:10:01] Create Tiller RBAC [started]
[12:10:01] Create Tiller RBAC [completed]
[12:10:01] Create Tiller Service [started]
[12:10:08] Create Tiller Service...done. [title changed]
[12:10:08] Create Tiller Service...done. [completed]
[12:10:08] Preparing Che Helm Chart [started]
[12:10:08] Preparing Che Helm Chart...done. [title changed]
[12:10:08] Preparing Che Helm Chart...done. [completed]
[12:10:08] Updating Helm Chart dependencies [started]
[12:10:13] Updating Helm Chart dependencies...done. [title changed]
[12:10:13] Updating Helm Chart dependencies...done. [completed]
[12:10:13] Deploying Che Helm Chart [started]
[12:10:13] Deploying Che Helm Chart...done. [title changed]
[12:10:13] Deploying Che Helm Chart...done. [completed]
[12:10:13] πŸƒβ€  Running Helm to install Che [completed]
[12:10:13] βœ…  Post installation checklist [started]
[12:10:13] Che pod bootstrap [started]
[12:10:13] scheduling [started]
[12:10:13] scheduling...done. [title changed]
[12:10:13] scheduling...done. [completed]
[12:10:13] downloading images [started]
[12:10:26] downloading images...done. [title changed]
[12:10:26] downloading images...done. [completed]
[12:10:26] starting [started]
[12:10:48] starting...done. [title changed]
[12:10:48] starting...done. [completed]
[12:10:48] Che pod bootstrap [completed]
[12:10:48] Retrieving Che Server URL [started]
[12:10:48] Retrieving Che Server URL...http://che-che.10.0.148.224.nip.io [title changed]
[12:10:48] Retrieving Che Server URL...http://che-che.10.0.148.224.nip.io [completed]
[12:10:48] Che status check [started]
[12:10:48] Che status check [completed]
[12:10:48] βœ…  Post installation checklist [completed]

Full build log: https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/che7-e2e-tests/job/CHE-7-Happy-Path-Tests/338/

Installation method

  • chectl

Environment

  • OpenStack on CRW Central CI
    • RHEL 7.4

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:7 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
michealharringtoncommented, May 27, 2020

I’m still having the same issue.

minikube version
minikube version: v1.10.1
commit: 63ab801ac27e5742ae442ce36dff7877dcccb278
chectl server:start --platform minikube --installer=helm
β€Ί Current Kubernetes context: 'minikube'
  βœ” Verify Kubernetes API...OK
  βœ” πŸ‘€  Looking for an already existing Eclipse Che instance
    βœ” Verify if Eclipse Che is deployed into namespace "che"...it is not
  βœ” ✈️  Minikube preflight checklist
    βœ” Verify if kubectl is installed
    βœ” Verify if minikube is installed
    βœ” Verify if minikube is running
    ↓ Start minikube [skipped]
      β†’ Minikube is already running.
    βœ” Check Kubernetes version: Found v1.18.2.
    βœ” Verify if minikube ingress addon is enabled
    βœ” Enable minikube ingress addon
    βœ” Retrieving minikube IP and domain for ingress URLs...172.17.0.4.nip.io.
    ↓ Check if cluster accessible [skipped]
Eclipse Che logs will be available in '/tmp/chectl-logs/1590608546255'
  βœ” Start following logs
    ↓ Start following Operator logs [skipped]
    βœ” Start following Eclipse Che logs...done
    βœ” Start following Postgres logs...done
    βœ” Start following Keycloak logs...done
    βœ” Start following Plugin registry logs...done
    βœ” Start following Devfile registry logs...done
  βœ” Start following events
    βœ” Start following namespace events...done
 β€Ί   Warning: You can also use features rich 'OLM' installer to deploy Eclipse Che.
  βœ” πŸƒβ€  Running Helm to install Eclipse Che
    βœ” Verify if helm is installed
    βœ” Check Helm Version: Found v3.2.0+ge11b7ce
    βœ” Create Namespace (che)...done.
    βœ” Check Eclipse Che TLS certificate...going to generate self-signed one
      βœ” Check Cert Manager deployment...not deployed
      βœ” Deploy cert-manager...done
      βœ” Wait for cert-manager...ready
      βœ” Check Cert Manager CA certificate...generating new one
      βœ” Set up Eclipse Che certificates issuer...done
      βœ” Request self-signed certificate...done
      βœ” Wait for self-signed certificate...ready
      βœ” Retrieving Che self-signed CA certificate... is exported to /home/<>/cheCA.crt
    βœ” Check Cluster Role Binding...does not exists.
    βœ” Preparing Eclipse Che Helm Chart...done.
    βœ” Updating Helm Chart dependencies...done.
    βœ” Deploying Eclipse Che Helm Chart...done.
  βœ” βœ…  Post installation checklist
    βœ” Devfile registry pod bootstrap
      βœ” scheduling...done.
      βœ” downloading images...done.
      βœ” starting...done.
    βœ” Plugin registry pod bootstrap
      βœ” scheduling...done.
      βœ” downloading images...done.
      βœ” starting...done.
    βœ” Eclipse Che pod bootstrap
      βœ” scheduling...done.
      βœ” downloading images...done.
      βœ” starting...done.
    βœ” Retrieving Eclipse Che server URL... https://che-che.172.17.0.4.nip.io
    βœ” Eclipse Che status check
  βœ” Show important messages
    βœ” ❗[MANUAL ACTION REQUIRED] Please add Che self-signed CA certificate into your browser: /home/<>/cheCA.crt.
   Documentation how to add a CA certificate into a browser: https://www.eclipse.org/che/docs/che-7/installing-che-in-tls-mode-with-self-signed-certificates/#using-che-with-tls_installing-che-in-tls-mode-with-se
lf-signed-certificates
Command server:start has completed successfully.
curl -v https://che-che.172.17.0.4.nip.io
* Could not resolve host: che-che.172.17.0.4.nip.io
* Closing connection 0
curl: (6) Could not resolve host: che-che.172.17.0.4.nip.io

How do I make https://che-che.172.17.0.4.nip.io accessible to the host machine? Hitting 172.17.0.4 hits an nginx, which means I must be close, but the nip.io doesn’t seem to work for me.

I’ll gladly give anymore information that is needed.

0reactions
che-botcommented, Jan 15, 2020

Issues go stale after 180 days of inactivity. lifecycle/stale issues rot after an additional 7 days of inactivity and eventually close.

Mark the issue as fresh with /remove-lifecycle stale in a new comment.

If this issue is safe to close now please do so.

Moderators: Add lifecycle/frozen label to avoid stale mode.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Unable to bring up Eclipse che on Kubernetes - Stack Overflow
I am new to Eclipse che and kubernetes. I got Kubernetes installed on Ubuntu and am trying to run chectl server:start but it...
Read more >
Re: [che-dev] New issues triaged 2019-07-15 (25 new issues)
A lot of issues have no milestone but have been triaged. ... "Che is not accessible after being started by chectl on Kubernetes"...
Read more >
Running Eclipse Che on Kubernetes using Docker Desktop ...
Kubernetes being a standard of deploying cloud applications, ... chectl server:start --platform=docker-desktop --installer=helmΒ ...
Read more >
Installing eclipse che in Azure - Microsoft Q&A
You need not install chectl tool inside the created kuberenetes cluster. This chectl CLI utility needs to be installed after you connect to...
Read more >
Introduction to Devfile - GitHub Pages
As a continuation of this, the brand new devfile format was introduced, ... If you're a user of chectl tool, it is also...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found