question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support for Prometheus Exemplars

See original GitHub issue

It seems more and more people are interested in using Exemplars with Micrometer and Prometheus (I’m not sure if other backends support it), see:

Exemplars are metadata attached to metrics (see: Prometheus Exemplars), e.g.: traceId so that you can get an example traceId for your metrics.

This issue is for starting a discussion about this feature and checking the popularity of this possible feature.

Prometheus has Exemplar support for Counter and Histogram, so the subtasks for this issue are:

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:30
  • Comments:9 (3 by maintainers)

github_iconTop GitHub Comments

5reactions
jonatan-ivanovcommented, Jan 11, 2022

Hi @jjneely,

Yepp, it is around the corner, we are planning to add it in the next minor release of Micrometer (1.9.0).

Why don’t we have it right now? The exemplar support is quite new in the field: as far as I know (this might have changed) Prometheus is the only backend that supports exemplars and this feature is experimental. OTel Metrics is experimental too so as far as I know, there is no production-ready exemplar support exists as of today (I might be mistaken, please correct me if I’m wrong).

Our plan is to add Exemplar support to Micrometer in 1.9; as you pointed out, Sleuth already has it so after the feature is added to Micrometer the plan is to offer out-of-the-box Exemplar support with Micrometer and Spring Cloud Sleuth (with Prometheus as the backend).

2reactions
roadSurfercommented, Jul 26, 2021

Thanks @jonatan-ivanov, being able to jump from a metric of interest to a trace would be a huge boon. I only have passing familiarity with Sleuth (and, indeed, Micrometer), but I will at least take a look and see how much work is involved.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Feature flags - Prometheus.io
Exemplar storage is implemented as a fixed size circular buffer that stores exemplars in memory for all series. Enabling this feature will enable...
Read more >
Using Prometheus Exemplars to jump from metrics to traces in ...
A step-by-step guide to enable correlation between metrics and traces, using Prometheus, Grafana, Tempo, OpenTelemetry, and OpenMetrics.
Read more >
Exemplars - Grafana
No information is available for this page.
Read more >
Exemplars for distributed traces: A better approach to linking ...
This blogs lays out the pitfalls of exemplars while explaining a better approach to linking distributed traces and metrics.
Read more >
Warp-Speed Debugging with Prometheus Exemplars - YouTube
Warp-Speed Debugging with Prometheus Exemplars - Ian Billett, Red HatEffectively debugging distributed systems almost always requires ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found