Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`test_decorrelated_batch_normalization` is flaky

See original GitHub issue

This is part of https://github.com/chainer/chainer/issues/6903 effort.

Failure example: https://ci.preferred.jp/chainer.py27and35/2072/
Failure test case: TestDecorrelatedBatchNormalization_use_chainerx_false__chainerx_device_None__use_cuda_true__cuda_device_0__use_cudnn_never__cudnn_deterministic_false__autotune_false__cudnn_fast_batch_normalization_false__use_ideep_never_param_16_{ndim=1, contiguous='C', n_channels=8, groups=1, eps=2e-05, dtype=float32}.test_forward
Tolerance:

E       Not equal to tolerance rtol=0.001, atol=0.0001
E       
E       Mismatch: 1.25%
E       Max absolute difference: 0.00017256
E       Max relative difference: 0.00698882

Issue Analytics

State:
Created 4 years ago
Comments:10 (10 by maintainers)

Top GitHub Comments

1reaction

emcastillocommented, Aug 14, 2019

Reproduced, fails 290 times out of 10.000 tries. Talked to @toslunar and I will submit a PR applying his solution in #7900 for the link test case

0reactions

toslunarcommented, Nov 12, 2019

Happened again in v6 😞

The backport PR #8340 has not been merged.

Top Results From Across the Web

[1804.08450] Decorrelated Batch Normalization - arXiv

In this work, we propose Decorrelated Batch Normalization (DBN), which not just centers and scales activations but whitens them.

Decorrelated Batch Normalization - CVF Open Access

In this work, we propose Decorre- lated Batch Normalization (DBN), which not just centers and scales activations but whitens them. We explore multiple...

Decorrelated Batch Normalization Explained | Papers With Code

Decorrelated Batch Normalization (DBN) is a normalization technique which not just centers and scales activations but whitens them. ZCA whitening instead of ...

Released Chainer v6.4.0

Fix decorrelated batch normalization when groups ≠ 1 (#7825); Support mixed16/float16 GroupNormalization (#8113) ...

[ CVPR 2018 / Paper Summary ] Decorrelated Batch ...

Batch normalization is a technique that standardize a given mini batch, in this work the authors have extended the concept to Decorrelated Batch ......