Error in reading ground-truth labels while evaluating pre-trained model

Thanks a lot for making your code open source, and for fostering further research in this field!

I downloaded the pre-trained model that is linked here, and I also used the ImageSets as described in the issue #3 and placed the same in both the training and testing data folders. On running only the evaluation on the pre-trained model, using the kitti eval folder provided here as referenced in issue #4 I got this error:-

ERROR: Couldn't read: 004627.txt of ground truth. Please write me an email! An error occurred while processing your results

Could you please tell me how this error came about? And how I can fix it?

[ccerhan]

Thanks a lot for making your code open source, and for fostering further research in this field! I downloaded the pre-trained model that is linked here, and I also used the ImageSets as described in the issue #3 and placed the same in both the training and testing data folders. On running only the evaluation on the pre-trained model, using the kitti eval folder provided here as referenced in issue #4 I got this error:- ERROR: Couldn't read: 004627.txt of ground truth. Please write me an email! An error occurred while processing your results Could you please tell me how this error came about? And how I can fix it?

The evaluation will run the command “./evaluate_object_3d_offline {} {}”.format(label_dir, output_dir)" in kitti_eval.py. But the default config “smoke_gn_vector.yaml” using " TEST: (“kitti_test”,) " and TEST_SPLIT: “test” . And the test dataset has no label file, thus causing this problem. So you need to replace it with “TEST: (“kitti_train”,)” and TEST_SPLIT: “val”. Note that you should make sure the label_dir is exists and “./evaluate_object_3d_offline” can find it.

To make label_dir that can be found by “./evaluate_object_3d_offline”, change the line where label_dir is set to label_dir = os.path.join('..', '..', '..', '..', '..', '..', getattr(dataset, 'label_dir')).

[EphChem]

Thanks a lot for making your code open source, and for fostering further research in this field! I downloaded the pre-trained model that is linked here, and I also used the ImageSets as described in the issue #3 and placed the same in both the training and testing data folders. On running only the evaluation on the pre-trained model, using the kitti eval folder provided here as referenced in issue #4 I got this error:- ERROR: Couldn't read: 004627.txt of ground truth. Please write me an email! An error occurred while processing your results Could you please tell me how this error came about? And how I can fix it?

The evaluation will run the command “./evaluate_object_3d_offline {} {}”.format(label_dir, output_dir)" in kitti_eval.py. But the default config “smoke_gn_vector.yaml” using " TEST: (“kitti_test”,) " and TEST_SPLIT: “test” . And the test dataset has no label file, thus causing this problem. So you need to replace it with “TEST: (“kitti_train”,)” and TEST_SPLIT: “val”. Note that you should make sure the label_dir is exists and “./evaluate_object_3d_offline” can find it.

To make label_dir that can be found by “./evaluate_object_3d_offline”, change the line where label_dir is set to label_dir = os.path.join('..', '..', '..', '..', '..', '..', getattr(dataset, 'label_dir')).

On top of what @ccerhan mentioned above, I had to:

change os.chdir('../smoke/data/datasets/evaluation/kitti/kitti_eval') to os.chdir('./smoke/data/datasets/evaluation/kitti/kitti_eval')

change os.chdir('../tools') to os.chdir('../../../../../../tools')

also make sure to have gnuplot, ghostscript, texlive-extra-utils installed