Accuracy of Resnet50 is much higher than reported!

EDIT: Originally I title this issue “What epoch are reported results from?”, but after further results have come to light I’ve renamed it to: “Accuracy of Resnet50 is much higher than reported!”.

I’ve been reproducing some of these experiments and my output numbers don’t exactly line up. At the moment I’m currently assuming its due to different random number seeds for the Kaiming Normal initialization.

Is the accuracy you report always the accuracy of the test set on the 350th epoch? Or are you reporting the accuracy of the best epoch?

In my reproduction of the DPN92 experiment I my measured accuracy of the last epoch is 94.92%, but the highest overall accuracy was 95.10% on epoch 275.

Surprisingly, when I ran the Resnet50 example I got an accuracy of 95.72%! (but this is likely some issue on my end) (Edit: Actually it doesn’t seem to be; see bellow)

[ZHUANGHP]

I had over 95% with the model of this post with initial lr 0.1 momentum 0.9 weight decay 5e-4, decay of lr by 10 in 150 225 270 for a total of 300 epochs.

[AlphaQi]

我使用作者的code进行训练，使用20层的resnet，竟然达到了95.04%的准确率，表示震惊，这还没有用其他技巧