Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Some discussions about DivideMix implementation

See original GitHub issue

Hi, this is excellent work! I have read the paper and source code a few times in the past two weeks. They are inspiring, thanks for sharing them! I have two questions about your implementation, would you take a look when possible?

The first question is about co-guessing and label refinement in the train function. Is it safer to use net.eval() and net2.eval() in this block, then turn on net.train() before calculating the logits in line 101? I feel both net and net2 are used to prepare some labels in this block, which is just doing the evaluation. https://github.com/LiJunnan1992/DivideMix/blob/d9d3058fa69a952463b896f84730378cdee6ec39/Train_cifar.py#L62-L67

The second question is about the linear_rampup function. I didn’t understand the reason for multiple lambda_u with the current epoch number current. Could you explain that? https://github.com/LiJunnan1992/DivideMix/blob/d9d3058fa69a952463b896f84730378cdee6ec39/Train_cifar.py#L192-L194

Thank you very much!

Issue Analytics

State:
Created a year ago
Comments:5 (2 by maintainers)

Top GitHub Comments

1reaction

LiJunnan1992commented, Jul 19, 2022

The reason is that we observe gaussian distributions for the losses w.r.t correct&wrong labels.

0reactions

LiuCMUcommented, Jul 19, 2022

Got it, thanks for taking the time to answer the questions! Thank you very much!

Top Results From Across the Web

DivideMix: Learning with Noisy Labels as Semi-supervised ...

In this work, we propose DivideMix, a novel framework for learning with noisy labels by leveraging semi-supervised learning techniques.

DivideMix: Learning with Noisy Labels as Semi-supervised ...

Numerous efforts have been devoted to reduce the annotation cost when learning with deep networks. Two prominent directions include learning with noisy labels ......

DivideMix: Learning with Noisy Labels as Semi ... - Papertalk

Papertalk is an open-source platform where scientists share video presentations about their newest scientific results - and watch, like + discuss them.

DivideMix: Learning with Noisy Labels as Semi-supervised ...

In this work, we propose DivideMix, a novel framework for learning with noisy labels by leveraging semi-supervised learning techniques.

Contrast to Divide: Self-Supervised Pre-Training for Learning with ...

DivideMix (bottom row) for 20% and 90% noise at the end of warm-up stage, ... Some methods propose to remedy this problem by...