Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Crash at shape pre-training
See original GitHub issueI am trying to reproduce the results but meet some problems at ‘I. Shape Pre-Training’. I find the script would crash at validation of shape pre-training. It looks like a OOM issue because log says “killed” and it stop crashing if I set shuffle_buffer_size=False at shape.ini. Any suggestions would help!
I am using a machine with 4 3090 GPUs, 12 cpu cores and 60 GB memory. My dataset have 100 train data and 7 validate data. There are 120 test data, 99 train data, 99 val data at surf_root directory.
Issue Analytics
- State:
- Created 10 months ago
- Comments:7
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
modify the code to make it only affect validation
I found no shuffle_buffer_size in shape.ini, do I need to add shuffle_buffer_size = 0, or no_shuffle = True in modify base.py? @Woolseyyy An error : buffer_size must be greater than 0 occurred when setting shuffle_buffer_size = 0.