question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Helm installation fails with timeout on k8s 1.16.x

See original GitHub issue

Describe the bug Helm chart installation gets timed out waiting for readiness probe on k8s 1.16.x Readiness probe fails maybe because MutatingWebhookConfigurations is not created at all in k8s 1.16.x

works fine on k8s 1.18.x as expected on the same setup.

Expected behavior Helm chart installation succeeds and all 3 pods of the deployment are in ready state

Optional: To reproduce

Minikube

cd connaisseur/
sudo minikube start --driver=none --kubernetes-version=v1.16.15
sudo chown -R $USER $HOME/.kube $HOME/.minikube
make install
sudo minikube delete

sudo minikube start --driver=none --kubernetes-version=v1.18.0
sudo chown -R $USER $HOME/.kube $HOME/.minikube
make install
sudo minikube delete

Microk8s

cd connaisseur/
sudo snap refresh microk8s --classic --channel=1.16/stable
sudo microk8s start
sudo microk8s enable dns
sudo microk8s config > ~/.kube/config
make install
sudo microk8s stop

sudo snap refresh microk8s --classic --channel=1.18/stable
sudo microk8s start
sudo microk8s enable dns
sudo microk8s config > ~/.kube/config
make install
sudo microk8s stop

Optional: Versions (please complete the following information as relevant):

  • OS: Ubuntu-18.04 on wsl2
  • Kubernetes Cluster: microk8s-1.16/stable OR minikube-1.14(k8s-1.16.15, vm-driver=none)
  • Notary Server: notary.docker.io
  • Container registry: registry.docker.io
  • Connaisseur: master
  • Other:

Optional: Additional context <Add any other context or screenshots about the bug here.>

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
Starkteetjecommented, Nov 11, 2020

Hi @akuma5157

I tried setting up Connaisseur on kubernetes 1.16 with minikube (docker driver, driver none does not work with my setup) and that worked. Maybe pulling of the Connaisseur image took longer than the Bootstrap Sentinel Timeout, which can be changed here. Tldr of the ADR: To ensure Connaisseur Pods dont show ready, when the webhook does not exist, they need to check for it. Its existence would block deployment of Connaisseur though, so we have a special Pod to solve this chicken-egg problem that lives for 60s by default

If increasing the timeout solves your problem, we’d be interest to get that feedback and might decide to increase the default.

I’ll also try the microK8s setup just to be sure, but wanted to give you quick feedback

0reactions
Starkteetjecommented, Dec 4, 2020

Hey @akuma5157 since you did not come back to us, I’ll assume your issue was resolved. Feel free to reopen if you have additional questions.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Helm init fails on Kubernetes 1.16.0 · Issue #6374 - GitHub
helm. Error: error installing: the server could not find the requested resource $ helm init --debug --service-account tiller --- apiVersion: ...
Read more >
helm test failure: timed out waiting for the condition
This is great advice, but a helm timeout is usually due to the pod in the cluster that helm deployed the app to...
Read more >
Deployment Troubleshooting - Mojaloop Documentation
Mojaloop Helm release v10.x or less does not support Kubernetes v1.16 or greater ... When installing mojaloop helm charts, the following error occurs:...
Read more >
Releases | NGINX Ingress Controller
After running the helm upgrade command, run kubectl apply -f deployments/helm-chart/crds to upgrade the CRDs. SUPPORTED PLATFORMS: We will provide technical ...
Read more >
Install Helm on cluster fails with i/o timeout (#26805) - GitLab
When installing Helm on a self-hosted Kubernetes cluster, it throws an error after a minute or so stating "Something went wrong while ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found