Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

load_state_dict doesn't catch 'StopIteration' exception

See original GitHub issue

Hi everyone,

I am using icefall to train a RNNT model and after I start from a batch and load the sampler sate, the dynamicbucketsampler raise an StopIteration which resulted the program to abort. I think that “exception” should have been caught somewhere up the stack trace and processed.

-- Process 0 terminated with the following error:
Traceback (most recent call last):
  File "/home/azureuser/anaconda3/envs/icefall-torch1.10cu102/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 59, in _wrap
    fn(i, *args)
  File "/home/azureuser/codebase/icefall-birch/egs/gigaspeech/ASR/pruned_transducer_stateless2/train.py", line 869, in run
    train_dl = gigaspeech.train_dataloaders(
  File "/home/azureuser/codebase/icefall-birch/egs/gigaspeech/ASR/pruned_transducer_stateless2/asr_datamodule.py", line 320, in train_dataloaders
    train_sampler.load_state_dict(sampler_state_dict)
  File "/home/azureuser/codebase/lhotse-birch/lhotse/dataset/sampling/dynamic_bucketing.py", line 174, in load_state_dict
    self._fast_forward()
  File "/home/azureuser/codebase/lhotse-birch/lhotse/dataset/sampling/dynamic_bucketing.py", line 190, in _fast_forward
    next(self)
  File "/home/azureuser/codebase/lhotse-birch/lhotse/dataset/sampling/base.py", line 261, in __next__
    batch = self._next_batch()
  File "/home/azureuser/codebase/lhotse-birch/lhotse/dataset/sampling/dynamic_bucketing.py", line 233, in _next_batch
    batch = next(self.cuts_iter)
StopIteration

Issue Analytics

State:
Created a year ago
Comments:21

Top GitHub Comments

1reaction

zzzacworkcommented, Jul 24, 2022

Yeah, that was solved, I am using it for our training. And all epoch now contains the same correct number of batches! Thank you and I think we can close it now

On Sun, Jul 24, 2022 at 10:16 Piotr Żelasko @.***> wrote:

I was away for some time — can you clarify if the PR resolved the issue? Then I could close it.

— Reply to this email directly, view it on GitHub https://github.com/lhotse-speech/lhotse/issues/753#issuecomment-1193337786, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYKSSRD5N2UOGQNQPN4Q2Q3VVVM3ZANCNFSM5ZN7IHRQ . You are receiving this because you were mentioned.Message ID: @.***>

0reactions

pzelaskocommented, Jul 24, 2022

I was away for some time — can you clarify if the PR resolved the issue? Then I could close it.

Top Results From Across the Web

Why can't my except block catch a StopIteration exception?

The StopIteration exception is not raised in the yield call, so you won't be catching it with that try/except setup.

How to catch StopIteration Exception in Python? - Tutorialspoint

When an iterator is done, it's next method raises StopIteration. This exception is not considered an error.

StopIteration Exception in Python - Pylenin

Handle StopIteration error in Python using the try-except block. ... You can catch such errors using the StopIteration Exception class.

Python 3 Tutorial: How To Handle StopIteration Exception

In this Python 3 Tutorial we look at how to handle the StopIteration Exception in Python3. Be sure to like, share and comment...

PEP 479 – Change StopIteration handling inside generators

This PEP proposes a change to generators: when StopIteration is raised ... a StopIteration exception into a generator, if the generator doesn't catch...