Alluxio Metrics Don't Report Bytes Written
See original GitHub issueAlluxio Version: 1.8.1, 2.0.0-RC2
Describe the bug
When we perform write operations using the CLI (or any other means), the Alluxio metrics for Bytes Written
and Bytes Written UFS
never get incremented in the master at /api/v1/master
, /metrics/json
as well as ./bin/alluxio fsadmin report metrics
To Reproduce
using MUST_CACHE
as the write type:
./bin/alluxio-start.sh local
./bin/alluxio fs copyFromLocal LICENSE /LICENSE
./bin/alluxio fs persist /LICENSE
./bin/alluxio fsadmin report metrics
The metrics report will report no bytes written to Alluxio or the UFS
Expected behavior
The command-line metrics report and the REST endpoints should be reporting the bytes written to Alluxio and/or the UFS. Currently, it always seems to be 0.
Urgency minor
Additional context Reported via slack community
Issue Analytics
- State:
- Created 4 years ago
- Reactions:1
- Comments:6 (5 by maintainers)
Top Results From Across the Web
Metrics System - Alluxio v2.8.1 (stable) Documentation
This section gives an example of writing collected metrics to CSV files. ... If Alluxio is deployed in a cluster, this file needs...
Read more >List of Metrics - Alluxio v2.9.0 (stable) Documentation
Name Type Description
Master.AbsentCacheHits GAUGE Number of cache hits on the absent cache
Master.AbsentCacheMisses GAUGE Number of cache misses on the absent cache
Master.AbsentCacheSize GAUGE Size...
Read more >Scalability Tuning - Alluxio v2.9.0 (stable) Documentation
The section Metrics to Monitor describes methods to monitor and estimate ... might report request count per second that is higher than initiated...
Read more >List of Configuration Properties - Alluxio v2.9.0 (stable ...
Property Name Default Description
alluxio.conf.dynamic.update.enabled false Whether to support dynamic update pro...
alluxio.fuse.fs.name alluxio‑fuse The FUSE file system name.
alluxio.fuse.special.command.enabled false
Read more >User Command Line Interface - Alluxio v2.9.0 (stable ...
The runUfsIOTest command measures the read/write IO throughput from Alluxio cluster to the target HDFS. Usage: runUfsIOTest --path <hdfs-path> [--io-size <io- ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I can confirm that using write with CACHE_THROUGH updates metrics correctly for the UFSs (v 1.8.1).
Closing the issue - @calvinjia please open another issue to provide job service metrics.