question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Alluxio Metrics Don't Report Bytes Written

See original GitHub issue

Alluxio Version: 1.8.1, 2.0.0-RC2

Describe the bug When we perform write operations using the CLI (or any other means), the Alluxio metrics for Bytes Written and Bytes Written UFS never get incremented in the master at /api/v1/master, /metrics/json as well as ./bin/alluxio fsadmin report metrics

To Reproduce

using MUST_CACHE as the write type:

./bin/alluxio-start.sh local
./bin/alluxio fs copyFromLocal LICENSE /LICENSE
./bin/alluxio fs persist /LICENSE
./bin/alluxio fsadmin report metrics

The metrics report will report no bytes written to Alluxio or the UFS

Expected behavior

The command-line metrics report and the REST endpoints should be reporting the bytes written to Alluxio and/or the UFS. Currently, it always seems to be 0.

Urgency minor

Additional context Reported via slack community

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:1
  • Comments:6 (5 by maintainers)

github_iconTop GitHub Comments

2reactions
ferozzahidcommented, Jun 6, 2019

I can confirm that using write with CACHE_THROUGH updates metrics correctly for the UFSs (v 1.8.1).

0reactions
rastogiasrcommented, Jul 2, 2019

Closing the issue - @calvinjia please open another issue to provide job service metrics.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Metrics System - Alluxio v2.8.1 (stable) Documentation
This section gives an example of writing collected metrics to CSV files. ... If Alluxio is deployed in a cluster, this file needs...
Read more >
List of Metrics - Alluxio v2.9.0 (stable) Documentation
Name Type Description Master.AbsentCacheHits GAUGE Number of cache hits on the absent cache Master.AbsentCacheMisses GAUGE Number of cache misses on the absent cache Master.AbsentCacheSize GAUGE Size...
Read more >
Scalability Tuning - Alluxio v2.9.0 (stable) Documentation
The section Metrics to Monitor describes methods to monitor and estimate ... might report request count per second that is higher than initiated...
Read more >
List of Configuration Properties - Alluxio v2.9.0 (stable ...
Property Name Default Description alluxio.conf.dynamic.update.enabled false Whether to support dynamic update pro... alluxio.fuse.fs.name alluxio‑fuse The FUSE file system name. alluxio.fuse.special.command.enabled false
Read more >
User Command Line Interface - Alluxio v2.9.0 (stable ...
The runUfsIOTest command measures the read/write IO throughput from Alluxio cluster to the target HDFS. Usage: runUfsIOTest --path <hdfs-path> [--io-size <io- ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found