Cannot reproduce the results in IJB

Dear insightface: I have tried python2/python3 and mxnet-cu80/mxnet-cu90. But I cannot reproduce the results in https://github.com/deepinsight/insightface/blob/master/Evaluation/IJB/IJBC_Evaluation_MS1MV2.ipynb.

After running through the notebook, my ROC curve is somewhat strange:

If I directly use the downloaded results file (*.npy), rather than the file generated by myself, the ROC curve is normal.

I also investigate the features at images level, the cluster pattern can be observed, which means that the extracted features of the starting 128 images are correct.

When reproducing, I modify similarity_score = np.sum(feat1 * feat2, -1) to similarity_score = np.sum(feat1 * feat2, -1).flatten(). For python2, I do not change anything else; for python3, I modifies
img_input_feats = img_feats[:,0:img_feats.shape[1]/2] to img_input_feats = img_feats[:,0:img_feats.shape[1]//2].

Could you help me find out the problem? Thanks a lot!

[shiyuanyin]

I have the same error ,but the different numpy version ,the out is the same ,finally, I found the reason , because dtype=str ,save error , I modify int , the out t1 t2 is correct. pairs = np.loadtxt(path, dtype=int)

def read_template_pair_list(path): pairs = np.loadtxt(path, dtype=int) t1 = pairs[:,0].astype(np.int) t2 = pairs[:,1].astype(np.int)

[Light--]

i also can not reproduce the result, details: here even change numpy version…