About result of DPRNN in wham dataset

The commit verison: 631ef15 As the same as defualt run.sh, the configs are as follows. kernel size=2| chunk size=250 | batch size=3

To avoid the GPU memory problem, I set 3 GPUs to run and num_works=6.

However, during training stage, early stopping happened in epoch 73 and the program didn’t continue to run into evaluation stage. Then I modified the model.py according to issue84 and issue96. Finally, I get the result as follows.

Overall metrics :
{'sar': 17.253943631154222,
 'sar_imp': -131.92250498640834,
 'sdr': 16.610877080941982,
 'sdr_imp': 16.459834866636488,
 'si_sdr': 16.222455347439276,
 'si_sdr_imp': 16.223606457496334,
 'sir': 26.228243298887513,
 'sir_imp': 26.077201084582004,
 'stoi': 0.9599706205908263,
  'stoi_imp': 0.22192459732239528}

The result is different from the mentioned result in README.md.

Do you have any idea about the issue?

[KiAlexander]

Of couse, I will try it again. If it goes well, I will also report more result infomation in this issue.

[mpariente]

That seems weird indeed. I know early stopping changed behaviour between pl versions, maybe this is the source… Otherwise I don’t know.

Can we close it now?