Memory leak during training
See original GitHub issueDuring training, my RAM is constantly decreasing. I tried to use the garbage collector (gc.collect()
) after resetting the simulation, but it helps a little.
I made training in HoverAviary environment.
Issue Analytics
- State:
- Created a year ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Dealing with memory leak issue in Keras model training
Recently, I was trying to train my keras (v2.4.3) model with tensorflow-gpu (v2.2.0) backend on NVIDIA's Tesla V100-DGXS-32GB.
Read more >Memory leak in model.fit · Issue #37505 - GitHub
Hey, I was having the same issue. My current workaround is to save the model before deleting it and clearing the backend after...
Read more >Keras model training memory leak - Stack Overflow
I faced a similar issue while training different models in a same script. I collected some possible fixes and workarounds here : memory...
Read more >Memory Leak when training PPO on a single agent environment
I configured my PPO algorithm to use the MemoryTrackingCallback. I started off with testing only tens of iterations with a gpu and 6...
Read more >Debug a memory leak in .NET Core - Microsoft Learn
A memory leak may happen when your app references objects that it no longer needs to perform the desired task. Referencing said objects...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Ok, thank you for looking into this, I can’t reproduce the problem atm because I’m not on Ubuntu but I will remove the suggestion from the README.
I figured out the memory leak issue. I uncommented this line as recommended in the README. But if you don’t touch it, then everything is ok.