Providing a Proposal File

Hi there,

I was able to train a mask RCNN on my data set but run into problems when I run

python2 tool/test_net.py --cfg config/12_2017_baselines/MY_VERSION_OF_mask_rcnn_R-50-C4_sx.yaml

The error I get is

cfg.TEST.PROPOSAL_FILE = cfg.TEST.PROPOSAL_FILES[i] IndexError: tuple index out of range

I assume this arises because I did not specify a proposal file. My question is: in which format can I provide a proposal file for a private dataset?

Thanks, Christian

[ir413]

Hi @chrisby, we expect the proposals for a dataset to be provided in a pkl file that contains a serialized proposals dictionary with the following entries:

proposals.keys() - ['cfg', 'ids', 'scores', 'boxes']

where

proposals['cfg'] - config used to compute the proposals
proposals['ids][i] - id for the i-th image
proposals['scores'][i] - ndarray (N_i,) containing scores for the proposals in the i-th image
proposals['boxes'][i]  - ndarray (N_i, 4) containing coordinates (x1, y1, x2, y2) for the proposals in the i-th image

It may be instructive to download one of the proposal files from the Model Zoo and inspect it interactively. You may also find it useful to look at _add_proposals_from_file to see how proposals get loaded from file and rpn_generator to see how RPN proposals get computed and stored to a pkl file.

If you require proposals for COCO classes, you can use one of the RPN models from the Model Zoo to compute (and store in the expected format) the proposals for your dataset.

We plan to add the information about the proposals file format to the documentation in the future. In the meantime, let us know if the above is unclear.

[chrisby]

Thanks, that’s already very helpful! I think I will use one of the baseline RPNs to compute the proposal file an subsequently link it to my dataset.