question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Accuracy of Resnet50 is much higher than reported!

See original GitHub issue

EDIT: Originally I title this issue “What epoch are reported results from?”, but after further results have come to light I’ve renamed it to: “Accuracy of Resnet50 is much higher than reported!”.

I’ve been reproducing some of these experiments and my output numbers don’t exactly line up. At the moment I’m currently assuming its due to different random number seeds for the Kaiming Normal initialization.

Is the accuracy you report always the accuracy of the test set on the 350th epoch? Or are you reporting the accuracy of the best epoch?

In my reproduction of the DPN92 experiment I my measured accuracy of the last epoch is 94.92%, but the highest overall accuracy was 95.10% on epoch 275.

Surprisingly, when I ran the Resnet50 example I got an accuracy of 95.72%! (but this is likely some issue on my end) (Edit: Actually it doesn’t seem to be; see bellow)

Issue Analytics

  • State:open
  • Created 5 years ago
  • Comments:34

github_iconTop GitHub Comments

5reactions
ZHUANGHPcommented, Nov 15, 2019

I had over 95% with the model of this post with initial lr 0.1 momentum 0.9 weight decay 5e-4, decay of lr by 10 in 150 225 270 for a total of 300 epochs.

3reactions
AlphaQicommented, Jun 29, 2018

我使用作者的code进行训练,使用20层的resnet,竟然达到了95.04%的准确率,表示震惊,这还没有用其他技巧

Read more comments on GitHub >

github_iconTop Results From Across the Web

How can you increase the accuracy of ResNet50?
1 Answer 1 · Increase the dimension of the layers that are learned in transfer learning (make sure not to overfit) · Use...
Read more >
Mosaic ResNet Deep Dive - MosaicML
80% accuracy on 8x-A100 in 284 minutes, 1.77x faster and 0.2% more accurate than the highly competitive timm A2 baseline. We compare our...
Read more >
[1709.05011] ImageNet Training in Minutes - arXiv
State-of-the-art ImageNet training speed with ResNet-50 is 74.9% top-1 test accuracy in 15 minutes. We got 74.9% top-1 test accuracy in 64 ...
Read more >
A comparative analysis of eleven neural networks ... - NCBI
These features allow DenseNet to achieve better performance than ResNet with fewer ... Inception-v4 has a more unified and simplified architecture and more...
Read more >
Deep Residual Networks (ResNet, ResNet50) 2022 Guide
It has been observed that training the neural networks becomes more difficult with the increase in the number of added layers, and in...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found