question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

When I train my network, the program was blocked after the first epoch. I don’t know why this happeded.

Epoch0/800 Iter20/20: lr=2.00e-02 loss=2.75: [00:44<00:00, 1.32it/s]
Epoch0/800 Iter20/20: lr=2.00e-02 loss=2.75: [00:44<00:00, 1.31it/s]
[00:00<?,?it/s]

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:9 (3 by maintainers)

github_iconTop GitHub Comments

3reactions
zhangyunmingcommented, Jul 10, 2019

i have meet the same.

10 14:37:50 PyTorch Version 1.0.1, Furnace Version 0.1.1 10 14:37:50 PyTorch Version 1.0.1, Furnace Version 0.1.1 Epoch0/140 Iter200/200: lr=9.94e-03 loss=1.87: [00:52<00:00,10.18it/s]

[00:00<?,?it/s]10 14:38:47 Saving checkpoint to file /disk3t-2/zym/TorchSeg/log/cityscapes.bisenet.X39/snapshot/epoch-0.pth 10 14:38:47 Save checkpoint to file /disk3t-2/zym/TorchSeg/log/cityscapes.bisenet.X39/snapshot/epoch-0.pth, Time usage: prepare snapshot: 0.00449681282043457, IO: 0.08965277671813965 [00:00<?,?it/s]

0reactions
charlesCXKcommented, Jul 15, 2019

@charlesCXK Maybe you need to enlarge the share-memory of the second machine on the cluster.

Thanks! I asked to a colleague in the IT department but he said that he could not enlarge it. 2333

Read more comments on GitHub >

github_iconTop Results From Across the Web

Training Block - where athletes find what they need for training
Training Block is not just a platform: it is a central hub, a builder of community between athletes and local athlete-focused businesses. Here...
Read more >
What Is Block Training? - Men's Journal
Similar to the Western model, block training offers the lifter a set method of progression to improve any aspect of performance. The main...
Read more >
Block Training to Boost Your Endurance Performance - Firstbeat
The idea behind block training is to focus only on a few target abilities during training cycles, so that instead of training concurrently,...
Read more >
BLOCK | Athletic Performance Training Streamed Live & On ...
These 45 minute sessions are the complete six block training experience, available both live and on-demand. They are suitable for all sports, and...
Read more >
BLOCK Training Launches With Mission to Help Athletes of All ...
BLOCK is an athletic training and recovery system that helps people of all ages and abilities perform at their best while reducing the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found