Simultaneous copy jobs failing to copy all files
See original GitHub issue- Version (
cloudcmd -v
):v11.8.3
- Node Version
node -v
:v11.4.0
- OS (
uname -a
on Linux):Linux lavie-server 4.15.0-42-generic #45~16.04.1-Ubuntu SMP Mon Nov 19 13:02:27 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
- Browser name/version:
Google Chrome Version 71.0.3578.80 (Official Build) (64-bit)
- Used Command Line Parameters:
/usr/local/bin/cloudcmd --no-open --root /home/media/new/ -c /opt/cloudcmd/config.json
- Changed Config:
{
"name": "CloudCMD",
"auth": false,
"username": "a username",
"password": "a password",
"algo": "sha512WithRSAEncryption",
"editor": "edward",
"packer": "tar",
"diff": true,
"zip" : false,
"buffer": true,
"dirStorage": false,
"online": false,
"open": false,
"keysPanel": false,
"port": 14000,
"ip": null,
"root": "/home/media/new",
"prefix": "",
"prefixSocket": "",
"progress": true,
"contact": false,
"confirmCopy": true,
"confirmMove": true,
"configDialog": false,
"configAuth": false,
"oneFilePanel": false,
"console": false,
"syncConsolePath": false,
"terminal": false,
"terminalPath": "",
"terminalCommand": "",
"terminalAutoRestart": true,
"showConfig": false,
"showFileName": false,
"vim": false,
"columns": "name-size-date-owner-mode",
"export": false,
"exportToken": "root",
"import": false,
"importToken": "root",
"importUrl": "http://localhost:14000",
"importListen": false,
"log": true,
"dropbox": false,
"dropboxToken": ""
}
Thanks for building such a great file manager / editor!
Yesterday, I was copying about 10 music albums from my laptop (MacOS 10.14.1) + Chrome. I dragged and dropped them into cloudcmd. I did it via Wi-Fi, which was not very fast at the time, so the copy job took a while per album. I dragged and dropped them one by one, so in the end I had 10 different copy jobs running. When they all finished, about half of the albums did not contain all the songs that should have copied.
When having multiple copy jobs running at the same time, files get skipped. The files that were copied, seemed to have fully copied, so no half songs in my albums.
PS: I’ve got the root also in the command line parameters, because it didn’t get picked up from the config, in case you’re wondering.
Issue Analytics
- State:
- Created 5 years ago
- Reactions:1
- Comments:7 (4 by maintainers)
Top GitHub Comments
Thank you for your response! I’m sorry mine is a bit late, it’s due to the holidays.
Correct, I dragged files from a MacOS Finder window, straight into the browser windows with CloudCMD running on a Linux server.
It is possible that the copy jobs get cancelled due to a slow connection, it does it in a weird way though. Take a music album for example. One of them had 10 songs, clearly marked by an index number 1 - 10. Sometimes it copies song 1, 2, 3, 5, 9, 10, sometimes others, but always skipping songs in between.
I have tried to recreate the issue, but I could not do it. I tried it the exact same way as I did the first time: from an external harddrive from my MacOS finder window to CloudCMD, also from my internal harddrive directly and both from a Wi-Fi connection. Also, I tried a stable ethernet connection. The only thing that might not be the same: I re-located an access point that was too close to another, and was making the Wi-Fi network slow and interfered with it. So it might actually have been the Wi-Fi connection.
That being said. Isn’t it a good idea to build a queue of sorts, where one item gets copied at the time, where the timeout does not trigger when the copy job is running already, however slow? This way, the overall progress in percentages should be easier to show (it now jumps around for every copy job that is running).
Closed due to a long time of inactivity 🏝