Worker Active Clients metric can exceed 0 at rest
See original GitHub issueAlluxio Version: What version of Alluxio are you using?
2.6.2
Describe the bug A clear and concise description of what the bug is.
When performing back-to-back bin/alluxio runTests
, it is possible to see the Worker.ActiveClients
metric exceed
0
while at rest (i.e: there are no active jobs). This implies that the metric counter is being incremented more than it is decremented, or that there are hanging jobs.
To Reproduce Steps to reproduce the behavior (as minimally and precisely as possible)
- Install an Alluxio cluster locally following the documentation.
- Perform a couple
bin/alluxio runTests
. - Observe the
Worker.ActiveClients
metric at a Alluxio worker metrics sink.
Expected behavior
The metric Worker.ActiveClients
should be 0
when there are no jobs.
Additional context This metric was added as part of https://github.com/Alluxio/alluxio/pull/13856
Issue Analytics
- State:
- Created 2 years ago
- Comments:7 (7 by maintainers)
Top Results From Across the Web
Monitoring your instance using CloudWatch - Amazon Connect
Amazon Connect sends data about your instance to CloudWatch metrics so that you can collect, view, and analyze CloudWatch metrics for your Amazon...
Read more >Monitor apps - Azure App Service | Microsoft Learn
Learn how to monitor apps in Azure App Service by using the Azure portal. Understand the quotas and metrics that are reported.
Read more >Troubleshooting Control Center | Confluent Documentation
Check the security configuration for all brokers, metrics reporter, client interceptors, and Control Center (see debugging check configuration).
Read more >Monitoring and Instrumentation - Spark 3.3.1 Documentation
Executor Task Metrics. The REST API exposes the values of the Task Metrics collected by Spark executors with the granularity of task execution....
Read more >Google Cloud metrics - Monitoring
May exceed 100% if the machine type has multiple CPUs. ... are no files waiting to be uploaded when this metric is computed,...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@jiacheliu3 I also encountered this problem and submitted a PR https://github.com/Alluxio/alluxio/pull/14088 to solve this problem
fyi @dbw9580