Should Detector IOU Threshold be same as IOU threshold for mAP?
See original GitHub issueHi, I have a question regarding the detector iou threshold and mAP iou threshold and I think it will be a simple question or just a clarification. I am using yolov3 detector with various confidence threshold and iou threshold and trying to get mAP for each detector configuration. My goal here is I am doing grid search of confidence threshold and iou threshold values based on maximizing mAP. My question here is should I set iou threshold value (default as MINOVERLAP = 0.5
) same as the detector threshold?
For example, I run detector with iou threshold 0.1, 0.3, 0.5, 0.7, then should the iou threshold be same accordingly as 0.1, 0.3, 0.5, 0.7 in the variable MINOVERLAP
or does it have to be 0.5 to evaluate the detector performance for various iou threshold.
My assumption here is I should stick with 0.5 since I am measuring the detector performance for various iou threshold but decreasing MINOVERLAP
means mAP will be higher, which negate the meaning of assesing the performance on various detector iou threshold.
Issue Analytics
- State:
- Created 3 years ago
- Comments:5
Top GitHub Comments
You’re right. Detector iou is Independent of minoverlap. According to the pascal voc papers it is your responsibilty to filter the boxes before the evaluation.
Thank you for the insight!