Threshold

Hi, Could you please provide the threshold used in $INSIGHTFACE/src/eval/verification.py (The one that you used in your paper for test)

Thanks!

[ltkhang]

Why it is not fixed? When testing a data set, shouldn’t it be a fixed (Learned hyperparameter getting from the training)

Of course, the threshold is not fixed. For example you have MS1M dataset, there are 2 ways to find the threshold

1. You train all of the things and find a threshold on the train-set itself in a statistical way.
2. you split you set into train and val set, then apply a statistical method on val-set to find the best threshold. Finally, you can apply this threshold value on public test set such as LFW, Megaface, CFP, etc.

[ltkhang]

Actually in this line https://github.com/deepinsight/insightface/blob/master/recognition/eval/verification.py#L172 the author try to find the best accuracy by grid searching threshold value between 0 and 4 with 0.01 diff point. So every best accuracy obtained at a specific dataset is possibly at different thresholds. If i’m not mistaken at LFW the best thresholds is around 1.4 you can try it yourself at different dataset. Hope this can help @orlevit

I noticed this but it seems to be very “tricky”.

I joined a contest, that I had to upload the inference code google colab with verification method and the fixed threshold value for contest holders. then they will apply to their test set and announce the result later.

In this case, how can I find my best threshold? I applied my inference model on multiple benchmark datasets and use avg value of threshold values, after that, I applied this avg threshold to re-verify on the above benchmark datasets, luckily the result still achieved SOTA. Finally, I decided to use avg threshold to submit.