question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Simultaneous copy jobs failing to copy all files

See original GitHub issue
  • Version (cloudcmd -v): v11.8.3
  • Node Version node -v: v11.4.0
  • OS (uname -a on Linux): Linux lavie-server 4.15.0-42-generic #45~16.04.1-Ubuntu SMP Mon Nov 19 13:02:27 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
  • Browser name/version: Google Chrome Version 71.0.3578.80 (Official Build) (64-bit)
  • Used Command Line Parameters: /usr/local/bin/cloudcmd --no-open --root /home/media/new/ -c /opt/cloudcmd/config.json
  • Changed Config:
{
    "name": "CloudCMD",
    "auth": false,
    "username": "a username",
    "password": "a password",
    "algo": "sha512WithRSAEncryption",
    "editor": "edward",
    "packer": "tar",
    "diff": true,
    "zip" : false,
    "buffer": true,
    "dirStorage": false,
    "online": false,
    "open": false,
    "keysPanel": false,
    "port": 14000,
    "ip": null,
    "root": "/home/media/new",
    "prefix": "",
    "prefixSocket": "",
    "progress": true,
    "contact": false,
    "confirmCopy": true,
    "confirmMove": true,
    "configDialog": false,
    "configAuth": false,
    "oneFilePanel": false,
    "console": false,
    "syncConsolePath": false,
    "terminal": false,
    "terminalPath": "",
    "terminalCommand": "",
    "terminalAutoRestart": true,
    "showConfig": false,
    "showFileName": false,
    "vim": false,
    "columns": "name-size-date-owner-mode",
    "export": false,
    "exportToken": "root",
    "import": false,
    "importToken": "root",
    "importUrl": "http://localhost:14000",
    "importListen": false,
    "log": true,
    "dropbox": false,
    "dropboxToken": ""
}

Thanks for building such a great file manager / editor!

Yesterday, I was copying about 10 music albums from my laptop (MacOS 10.14.1) + Chrome. I dragged and dropped them into cloudcmd. I did it via Wi-Fi, which was not very fast at the time, so the copy job took a while per album. I dragged and dropped them one by one, so in the end I had 10 different copy jobs running. When they all finished, about half of the albums did not contain all the songs that should have copied.

When having multiple copy jobs running at the same time, files get skipped. The files that were copied, seemed to have fully copied, so no half songs in my albums.

PS: I’ve got the root also in the command line parameters, because it didn’t get picked up from the config, in case you’re wondering.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:1
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
Waxyencommented, Jan 3, 2019

Thank you for your response! I’m sorry mine is a bit late, it’s due to the holidays.

Correct, I dragged files from a MacOS Finder window, straight into the browser windows with CloudCMD running on a Linux server.

It is possible that the copy jobs get cancelled due to a slow connection, it does it in a weird way though. Take a music album for example. One of them had 10 songs, clearly marked by an index number 1 - 10. Sometimes it copies song 1, 2, 3, 5, 9, 10, sometimes others, but always skipping songs in between.

I have tried to recreate the issue, but I could not do it. I tried it the exact same way as I did the first time: from an external harddrive from my MacOS finder window to CloudCMD, also from my internal harddrive directly and both from a Wi-Fi connection. Also, I tried a stable ethernet connection. The only thing that might not be the same: I re-located an access point that was too close to another, and was making the Wi-Fi network slow and interfered with it. So it might actually have been the Wi-Fi connection.

That being said. Isn’t it a good idea to build a queue of sorts, where one item gets copied at the time, where the timeout does not trigger when the copy job is running already, however slow? This way, the overall progress in percentages should be easier to show (it now jumps around for every copy job that is running).

0reactions
coderaisercommented, Jun 5, 2019

Closed due to a long time of inactivity 🏝

Read more comments on GitHub >

github_iconTop Results From Across the Web

Backup Copy Jobs - Failing when weekly rollover occurs.
The backup copy jobs seem to run as they should. However at any given time we start receiving the following error (can be...
Read more >
Backup Copy Job - This Site Is Depreciated
Backup copy jobs read specific VM restore points from backup files and store them as a new backup file chain on the destination....
Read more >
Copying artifacts from multiple upstream jobs at join in Jenkins
We have a similar situation where I work; multiple simultaneous runs of a join-diamond. The parameter in the build allows the downstream jobs...
Read more >
How do I queue files instead of simultaneously copying them ...
In case of copy error, TeraCopy will try several times and in the worse case just skips the file, not terminating the entire...
Read more >
CopyFiles@2 - Copy files v2 task - Microsoft Learn
Copy files from a source folder to a target folder using patterns matching file paths ... copies all files in the specified source...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found