question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Alluxio CLI code for distributed load and copy always return zero.

See original GitHub issue

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I’m always frustrated when […] I am interacting with the Alluxio form python code by creating the python sub process and executing commands like distributed load and copy. Alluxio code for distributed load and copy always return the zero value even though it couldn’t succeed in loading or copying all the files. For example, Completed count is 203,Failed count is 617. Code reference: https://github.com/Alluxio/alluxio/blob/2df1da2d4f6caa47574640bf54c52447e8c0f3ea/shell/src/main/java/alluxio/cli/fs/command/DistributedLoadCommand.java#L314 https://github.com/Alluxio/alluxio/blob/2df1da2d4f6caa47574640bf54c52447e8c0f3ea/shell/src/main/java/alluxio/cli/fs/command/DistributedCpCommand.java#L150 Describe the solution you’d like A clear and concise description of what you want to happen. If Alluxio code returns the appropriate integer value like -1 (Exception), 0(Successful) or 1(Error) , it would help parent process to take the decision and control the code flow accordingly. For example, in case of distributed load cli command, if Alluxio loads all the files it should return 0 to indicate successful copy; if it loads partial files and failed for other files, it should return 1 to indicate error in copying all the files; if it faces any exception while doing distributed load, it should return -1 to indicate its process abruption. Describe alternatives you’ve considered A clear and concise description of any alternative solutions or features you’ve considered. As of now, Alluxio returns the zero value for any situation and prints the line Completed count is %d,Failed count is %d. on console. I need to take the python sub process output, parse it, find the Failed count and make the decision like whether distributed load succeeded or not. Urgency Explain why the feature is important It makes more sense to return appropriate value of the process rather than zero for all the situations. That’s how CLI works. Additional context Add any other context or screenshots about the feature request here.

Issue Analytics

  • State:open
  • Created 2 years ago
  • Comments:9 (9 by maintainers)

github_iconTop GitHub Comments

2reactions
vimalKeshucommented, Feb 18, 2022

@jja725 that’s cool ! agree, it would be duplicate effort. I am ready to help (design review, development, testing etc…) in case if you need. thank you.

2reactions
jja725commented, Feb 8, 2022

Thanks for raising this issue! This is on our radar and would be addressed in the 2.8 release @vimalKeshu

Read more comments on GitHub >

github_iconTop Results From Across the Web

User Command Line Interface - Alluxio v2.9.0 (stable ...
Alluxio's command line interface provides users with basic file system operations. ... If the key is invalid, it returns a nonzero exit code....
Read more >
Metadata Synchronization in Alluxio: Design, Implementation ...
Alluxio maintains a copy of the file system or the object store ... By default, Alluxio loads the metadata from the under storage...
Read more >
Architecture - Alluxio v2.9.0 (stable) Documentation
Loading data into Alluxio from a UFS; Persisting data to a UFS; Replicating files within Alluxio; Moving or copying data between UFS or...
Read more >
Caching - Alluxio v2.9.0 (stable) Documentation - Introduction
Loading Data into Alluxio Storage​​ To load data from the local file system, use the command alluxio fs copyFromLocal . This will only...
Read more >
List of Configuration Properties - Alluxio v2.9.0 (stable ...
Property Name Default Description alluxio.conf.dynamic.update.enabled false Whether to support dynamic update pro... alluxio.fuse.fs.name alluxio‑fuse The FUSE file system name. alluxio.fuse.special.command.enabled false
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found