question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

dat share runs out of memory, crashes

See original GitHub issue

I am reporting:

  • a bug or unexpected behavior
  • general feedback
  • feature request
  • security issue

Bug Report

  • Operating system: Debian Stretch
  • Node Version: v8.11.3
  • Dat Version: 13.11.3

Expected behavior

I’m trying to run dat on a fairly constrained VPS. I need to be able to sync about 50 GB over about 25000 files and about as many symbolic links. Files range in size from under 1 KB to over 1 GB.

Expected behavior is dat share scanning the files and sharing them without using too much memory / CPU.

Actual behavior

dat pegs the CPU at 100% and memory usage quickly grows until it gets to about ~256 MB of res memory, and then gets killed by the OS.

Debug Logs

dat.log

Issue Analytics

  • State:open
  • Created 5 years ago
  • Reactions:1
  • Comments:5

github_iconTop GitHub Comments

1reaction
okdistributecommented, Mar 31, 2020

@afontenot hyperdrive is used by dat, this is a new version of that library that includes a CLI

0reactions
afontenotcommented, Mar 31, 2020

This should be fixed in the latest beta, see github.com/andrewosh/hyperdrive-daemon to test it out

[link corrected]

Is this project built on dat? It’s not clear to me from the documentation. Perhaps some clarification of what that project’s relationship to this one is would be useful in the README.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Dying, fast and slow: out-of-memory crashes in Python
Crashing is just one symptom of running out of memory. Your process might instead just run very slowly, your computer or VM might...
Read more >
Out of memory crash during stacking (#623) · Issues · FA / Siril
Re-running with the memory management ratio turned down to 0.5 of available. I won't be able to check the result until tomorrow.
Read more >
Project Zomboid - Gpu out of memory crash?
Gpu out of memory crash? lately it seems Pz is causing gpu Mem usage to go 100% and then crashes the game. Nothing...
Read more >
AWS Aurora running out of freeable memory and crashing
We have an issue with our AWS Aurora MySQL instance running out of freeable memory and crashing as a result. AWS's response was...
Read more >
"out of memory" ESO crashing my system.
It might point to sloppy programming where one function might not be freeing the memory it reserves for its run. The memory use...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found