Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
prometheus failed. unable to fetch node metrics for pod/node
See original GitHub issuemicrok8s.enable dns storage prometheus
# add
# --authentication-token-webhook
# --authorization-mode=Webhook
# to /var/snap/microk8s/current/args/kubelet
systemctl restart snap.microk8s.daemon-kubelet.service
microk8s.kubectl top pods -n monitoring # Sometimes not all of pods show
microk8s.kubectl top nodes # Sometimes it fails error: metrics not available yet
# And there are so many "No data points" in Grafana.
logs
# microk8s.kubectl -n monitoring logs prometheus-adapter-644b448b48-qfmn4
I0709 10:14:43.135186 1 serving.go:273] Generated self-signed cert (/var/run/serving-cert/apiserver.crt, /var/run/serving-cert/apiserver.key)
I0709 10:14:43.791417 1 serve.go:96] Serving securely on [::]:6443
E0709 10:31:17.912953 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:31:21.001657 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:31:21.001678 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:31:22.931143 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:31:22.931165 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:31:37.199425 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5, skipping
E0709 10:31:37.199442 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:31:37.199450 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:31:37.199456 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:31:37.199462 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:31:37.199468 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:31:37.199474 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:31:37.199480 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:31:37.199486 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/coredns-f7867546d-bs8h6, skipping
E0709 10:31:37.199494 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5: no metrics known for pod
E0709 10:31:37.199500 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:31:37.199505 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:31:37.199509 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:31:37.199514 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:31:37.199518 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:31:37.199525 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:31:37.199530 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:31:37.199534 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/coredns-f7867546d-bs8h6: no metrics known for pod
E0709 10:31:38.886907 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:31:38.886920 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:31:38.886926 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5, skipping
E0709 10:31:38.886931 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:31:38.886935 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:31:38.886940 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:31:38.886944 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:31:38.886949 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:31:38.886954 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/coredns-f7867546d-bs8h6, skipping
E0709 10:31:38.886962 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:31:38.886967 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:31:38.886971 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5: no metrics known for pod
E0709 10:31:38.886974 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:31:38.886977 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:31:38.886981 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:31:38.886984 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:31:38.886987 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:31:38.886991 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/coredns-f7867546d-bs8h6: no metrics known for pod
E0709 10:31:40.523725 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:31:40.523744 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:31:52.698774 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:31:52.698788 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:31:52.698793 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:31:52.698798 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:31:52.698802 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:31:52.698807 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:31:52.698812 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:31:52.698817 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:31:52.698821 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:31:52.698824 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:31:52.698828 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:31:52.698831 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:31:52.698834 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:31:52.698838 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:31:55.323316 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:31:55.323343 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:31:55.323349 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:31:55.323353 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:31:55.323358 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:31:55.323362 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:31:55.323367 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:31:55.323372 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:31:55.323376 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:31:55.323380 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:31:55.323383 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:31:55.323400 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:31:55.323403 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:31:55.323407 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:33:04.186090 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:33:04.186128 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:33:07.053261 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:08.020506 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:08.714641 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:09.350445 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:10.734974 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:26.833487 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:28.089530 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:38.920909 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:40.387904 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:41.808205 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:43.088045 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:53.923966 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:33:55.102181 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:35:22.157722 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:35:22.157755 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:35:23.841795 1 reststorage.go:91] Error while fetching pod metrics for selector in namespace "default": no pods to fetch metrics for
E0709 10:35:23.841816 1 status.go:64] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"Error while fetching pod metrics for selector in namespace \"default\": no pods to fetch metrics for"}
E0709 10:35:32.327421 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/coredns-f7867546d-bs8h6, skipping
E0709 10:35:32.327436 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:35:32.327441 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:35:32.327446 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:35:32.327450 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:35:32.327469 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:35:32.327473 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:35:32.327478 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:35:32.327482 1 provider.go:185] unable to fetch CPU metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5, skipping
E0709 10:35:32.327488 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/coredns-f7867546d-bs8h6: no metrics known for pod
E0709 10:35:32.327493 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:35:32.327497 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:35:32.327500 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:35:32.327505 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:35:32.327508 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:35:32.327512 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:35:32.327515 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:35:32.327518 1 reststorage.go:144] unable to fetch pod metrics for pod kube-system/hostpath-provisioner-58564cb894-6zbw5: no metrics known for pod
E0709 10:35:51.236953 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:35:51.236970 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:35:52.492852 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:35:52.492867 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:35:52.492874 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:35:52.492878 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:35:54.551027 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:35:55.776190 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:35:56.896336 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:35:57.908963 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:35:59.739872 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:36:17.325535 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:36:17.325553 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:36:22.609235 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:36:22.609250 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:36:22.609255 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:36:22.609262 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:36:22.609265 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:36:22.609269 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:36:24.234770 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:36:25.652080 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:36:25.652094 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:36:25.652099 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:36:25.652106 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:36:25.652109 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:36:25.652112 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:36:27.552608 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:36:42.944701 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:36:42.944716 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:36:53.768911 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:36:53.768927 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:36:53.768933 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:36:53.768937 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:36:53.768942 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:36:53.768947 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:36:53.768952 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:36:53.768956 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:36:53.768960 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:36:53.768963 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:36:53.768967 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:36:53.768970 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:36:57.372029 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:36:58.191255 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:36:58.191268 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:36:58.191291 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:36:58.191296 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:36:58.191300 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:36:58.191305 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:36:58.191309 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:36:58.191317 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:36:58.191320 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:36:58.191324 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:36:58.191327 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:36:58.191331 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:36:58.191334 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:36:58.191337 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:37:01.118826 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:37:11.484680 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:37:11.484699 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:37:14.422128 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:37:14.422143 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:37:14.422169 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:37:14.422174 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:37:18.240770 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:37:18.240785 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:37:18.240791 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:37:18.240795 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:37:23.137809 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:37:23.137825 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:37:23.137831 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:37:23.137838 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:37:23.137842 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:37:23.137845 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:37:24.904180 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:37:25.985491 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:37:25.985504 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/grafana-7789c44cc7-cwtqs, skipping
E0709 10:37:25.985510 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:37:25.985515 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:37:25.985519 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:37:25.985527 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:37:25.985531 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/grafana-7789c44cc7-cwtqs: no metrics known for pod
E0709 10:37:25.985534 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:37:25.985537 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:37:25.985540 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:37:27.788863 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:58.318184 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:58.553988 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:58.764694 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:58.988312 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:59.206313 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:43:59.926365 1 reststorage.go:129] unable to fetch node metrics for node "v": no metrics known for node
E0709 10:44:26.039502 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7, skipping
E0709 10:44:26.039515 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/alertmanager-main-0, skipping
E0709 10:44:26.039520 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:26.039525 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/node-exporter-tqf55, skipping
E0709 10:44:26.039529 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:26.039534 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq, skipping
E0709 10:44:26.039542 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-operator-7695b59fb8-4krf7: no metrics known for pod
E0709 10:44:26.039546 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/alertmanager-main-0: no metrics known for pod
E0709 10:44:26.039550 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:26.039553 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/node-exporter-tqf55: no metrics known for pod
E0709 10:44:26.039557 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:26.039560 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/kube-state-metrics-78c549dd89-dhlpq: no metrics known for pod
E0709 10:44:49.139251 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:49.139266 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:49.372713 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:49.372739 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:49.676417 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:49.676433 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:49.887151 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:49.887171 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:50.193095 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:50.193112 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:50.193120 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:50.193124 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:50.457113 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:50.457129 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:50.457138 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:50.457142 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:50.715571 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:50.715585 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:50.715595 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:50.715599 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:50.996359 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:50.996377 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:50.996396 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:50.996401 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:51.243024 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:51.243055 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:51.243063 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:51.243067 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
E0709 10:44:53.355715 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4, skipping
E0709 10:44:53.355733 1 provider.go:185] unable to fetch CPU metrics for pod monitoring/prometheus-k8s-0, skipping
E0709 10:44:53.355758 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-adapter-644b448b48-qfmn4: no metrics known for pod
E0709 10:44:53.355775 1 reststorage.go:144] unable to fetch pod metrics for pod monitoring/prometheus-k8s-0: no metrics known for pod
Issue Analytics
- State:
- Created 4 years ago
- Reactions:2
- Comments:13 (3 by maintainers)
Top Results From Across the Web
prometheus failed. unable to fetch node metrics for pod/node
Same issue here, been trying for hours to get it work but nope. @ktsakalozos are there any news on this? The top command...
Read more >Kubernetes Metrics unable to fetch pod/node metrics
I found the following solution: Change the metrics-server-deployment.yaml file and add: command: - /metrics-server ...
Read more >Prometheus adapter reports "unable to fetch CPU metrics" for ...
Prometheus adapter reports "unable to fetch CPU metrics" for completed and succeeded pods. No translations currently exist.
Read more >The case of disappearing metrics in Kubernetes
How I debugged when metrics failed to appear in the grafana dashboard. ... Prometheus related) and the error unable to fetch pod metrics...
Read more >Out-of-memory (OOM) in Kubernetes – Part 3 - Mihai-Albert.com
Grafana needs only to define one data source for Prometheus to get all the metrics; cAdvisor – which is currently built in the...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Hi @Pflegusch,
1.18/stableis not the same aslatest/stable. We recently did a few updates in Prometheus and the metric server. Could you make sure you have these addons enabled? You may want to disable them and re-enable them to get the updated manifests applied.This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.