Folders missing from the Zenodo files

Hi @hendrycks.

I downloaded the four different tars as provided here: https://zenodo.org/record/3565846.

I think I am missing four folders here although I ensured the tars are not corrupted:

As per ImageNet-P/test.py I expected to see all the perturbations:

['gaussian_noise', 'shot_noise', 'motion_blur', 'zoom_blur',
                             'spatter', 'brightness', 'translate', 'rotate', 'tilt', 'scale',
                             'speckle_noise', 'gaussian_blur', 'snow', 'shear']

Also, inside the noise perturbations, I did not see separate difficulties as indicated inside the code.

Am I missing out on something?

[hendrycks]

Yes.

[sayakpaul]

@hendrycks,

I have collected the TD5s and FRs (standardized with AlexNet TD5 and FR) on the 10 perturbations provided in the Zenodo files for difficulty 1.

Using what’s laid out in the “IMAGENET-P Metrics” section of the paper, do I have the correct data to now report mFR and mT5D?