Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
The model can not converge
See original GitHub issueI train the swin_tiny_patch4_window7_224 with one million classes and 100 million images with softmax loss and adamw, the batch size is 600 and train for 400,000 iterations but the model can not converge.
Issue Analytics
- State:
- Created 2 years ago
- Comments:8 (2 by maintainers)
Top Results From Across the Web
Logistic regression model does not converge - Cross Validated
By convergence I mean that the parameters being estimated in the model don't change (or only change less than some small tolerance) between ......
Read more >RS2/RS3 - Why isn't my model converging? - Rocscience
Non-convergence can occur for a variety of reasons. Your model could contain bad elements, the geometry may be overly complex, your model may...
Read more >Troubleshooting Convergence Problems - SAS OnlineDoc, V8
If the procedure fails to converge because it is unable to find a change vector that improves the objective value, check your model...
Read more >Why would a model not converge in Logistic regression?
Especially if your model has 12 covariates you need enough data points in each of the two categories of the DV in order...
Read more >When does a neural network fail to converge?
The convergence can be of two types either global or local. One thing that is noticeable here is that convergence should happen with...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
My model can converge now. I train the model with softmax loss, and setting
warm up itersandbatch sizelarge can converge normally.@hdmjdp How did you solve this issue?