The model can not converge
See original GitHub issueI train the swin_tiny_patch4_window7_224
with one million classes and 100 million images with softmax loss and adamw, the batch size is 600 and train for 400,000 iterations but the model can not converge.
Issue Analytics
- State:
- Created 2 years ago
- Comments:8 (2 by maintainers)
Top Results From Across the Web
Logistic regression model does not converge - Cross Validated
By convergence I mean that the parameters being estimated in the model don't change (or only change less than some small tolerance) between ......
Read more >RS2/RS3 - Why isn't my model converging? - Rocscience
Non-convergence can occur for a variety of reasons. Your model could contain bad elements, the geometry may be overly complex, your model may...
Read more >Troubleshooting Convergence Problems - SAS OnlineDoc, V8
If the procedure fails to converge because it is unable to find a change vector that improves the objective value, check your model...
Read more >Why would a model not converge in Logistic regression?
Especially if your model has 12 covariates you need enough data points in each of the two categories of the DV in order...
Read more >When does a neural network fail to converge?
The convergence can be of two types either global or local. One thing that is noticeable here is that convergence should happen with...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
My model can converge now. I train the model with softmax loss, and setting
warm up iters
andbatch size
large can converge normally.@hdmjdp How did you solve this issue?