question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Conflict between prometheos and metrics-server

See original GitHub issue

I wanted to monitor my cluster and pods and I decided to install the prometheos addon of the microk8s. I was able to see some of the metrics of the node but then I noticed that my auto scalers (hpa) not working and when I got kubectl get hpa I received <unknown>/75%.

After some inspections and trial and error I found out the problem is promethous and after disabling it and later disabling and enabling metrics-server the auto-scalers started to work properly again. My question is, is there a conflict between microk8s addons? Because I have installed both promethous and metrics-server via microk8s.enable OR the problem is promethous and its components have a real conflict with metrics-server? My next question is how can I solve this?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:1
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
avarfcommented, Aug 1, 2019

Hi again, Just wanted to let you know that I installed prometheos via its helm chart and everything is good and working. I followed this link: https://medium.com/@at_ishikawa/install-prometheus-and-grafana-by-helm-9784c73a3e97 and the only change that I made was creating my own prometheus-values.yaml:

alertmanager:
  persistentVolume:
    enabled: false

server:
  persistentVolume:
    enabled: false

And I installed it with this command:

helm install --name prometheus stable/prometheus -f prometheus-values.yaml

I didn’t check your manifests but I noticed two changes:

  • Microk8s addon installs prometheus in a separate namespace (I don’t think this is important)
  • If I remember correctly Microk8s prometheus addon installs its own metrics-server but prometheus helm dosn’t install a metrics-server and it uses kube-state-metrics:
prometheus-alertmanager-65f49796f5-gfs5d
prometheus-kube-state-metrics-64f766f4cd-m7754
prometheus-node-exporter-2dtb5
prometheus-pushgateway-7bfc59b475-pq6wr
prometheus-server-6f6975d889-5vpcn

I hope these can help.

0reactions
stale[bot]commented, Jun 26, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Conflict between prometheos and metrics-server #562 - GitHub
My question is, is there a conflict between microk8s addons? Because I have installed both promethous and metrics-server via microk8s.enable OR ...
Read more >
Conflict with kube-prometheus when installing metric-server
What are my options if I'd like to get metric-server installed along with kube-prometheus ? Should I override or merge? Is that a...
Read more >
Troubleshooting Managed Service for Prometheus
Delete any conflicting metrics with the "unknown" or "unknown:counter" suffix by calling DeleteMetricDescriptor. Time-series collisions. If you see one of the ...
Read more >
Configuration - Prometheus.io
[ metrics_path: <path> | default = /metrics ] # honor_labels controls how Prometheus handles conflicts between labels that are # already present in...
Read more >
Prometheus Custom Metrics Adapter | Rancher Manager
This is a great example for the custom metrics server. And you must be the cluster owner to execute following steps. Get the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found