question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

kube-apiserver: very high memory load in Raspberry PI

See original GitHub issue

Hi,

I’m running a freshly installed MicroK8s cluster v1.20 on top of Ubuntu Server 20.04 on 3 Raspberry PI v4. After a couple of hours I noticed that some of my pods are not responing anymore and kubectl doesn’t return anything either. A look onto the system reveled the issue: full memory and the process kube-apiserver took around 70-80 % of it.

image

At the moment I execute sudo snap restart microk8s.daemon-apiserver every hour (cronjob) to keep the cluster somehow alive.

Recently I switched from K3s to MicroK8s due to high cpu and memory load in K3s. Maybe there is an overall issue with K8s on top of Raspberry PIs?

Targerball of microk8s inspect: inspection-report-20210115_091600.tar.gz

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:2
  • Comments:9

github_iconTop GitHub Comments

3reactions
Ramblurrcommented, Jan 29, 2021

For folks landing here from Google, this seems to be the current summary:

  • There’s a memory leak when HA mode is enabled
  • There is no solution or workaround that lets you keep using HA mode
  • Disable HA mode might fix it, but you might have to purge and reinstall
1reaction
balchuacommented, Feb 15, 2021

To those who are interested, tthere are few fixes on dqlite. The fixes will be backported to 1.19. and 1.20.

My personal test so far is promising.

https://github.com/ubuntu/microk8s/issues/1598#issuecomment-779044844

Read more comments on GitHub >

github_iconTop Results From Across the Web

kube-apiserver: very high memory load in Raspberry PI #1900
This is a memory leak bug. Try to monitor the memory usage and restart the API server. sudo systemctl status snap.microk8s.daemon-apiserver sudo ...
Read more >
kube-apiserver in Rancher cluster consuming insane ... - Reddit
About 2 months ago, it suddenly started running itself out of memory, specifcally kube-apiserver was consuming all the memory, but only on 1 ......
Read more >
1906151 – High CPU/Memory usage of Kube API server ...
We debugged the cluster and we saw that nmstate-handler pods use significant amount of CPU all the time. ... The apiserver load significantly...
Read more >
Is Vanilla Kubernetes Really Too Heavy For The Raspberry Pi?
A detailed look into the CPU and memory performance of K3s versus vanilla Kubernetes with Talos on the Raspberry Pi.
Read more >
Quality-of-Service for Memory Resources | Kubernetes
And if memory limits are set in the container, this means that the system needs to limit container memory usage, Memory QoS uses...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found