question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Got poor performance on custom dataset.

See original GitHub issue

I trained custom pascal_voc dataset with cascade_rcnn_hrnetv2p_w32_20e.py, I used all the data as trainval, and part of it as test, after 20 epochs, the loss decrease to 0.3, and the log info like this:

INFO - Epoch [16][450/715]    lr: 0.00250, eta: 3:52:14, time: 0.801, data_time: 0.004, memory: 9102, loss_rpn_cls: 0.0239, loss_rpn_bbox: 0.0093, s0.loss_cls: 0.1392, s0.acc: 96.1270, s0.loss_bbox: 0.0731, s1.loss_cls: 0.0549, s1.acc: 97.1621, s1.loss_bbox: 0.0480, s2.loss_cls: 0.0183, s2.acc: 98.4102, s2.loss_bbox: 0.0135, loss: 0.3802

And I used the checkpoint to run test.py and generate result.pkl, but after the I parsed the .pkl file, set score threshold 0.5, the result is not good, lots of images have no predictions. So what can I do to improve the performance or is there somewhere I forgot to modified. Thanks~

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:9 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
wen0618commented, Nov 1, 2019

@herrickli Have you solved your problem?My result is poor too. The loss is less than 0.0015 but the mAP is not good.

1reaction
xhqiuicommented, Oct 22, 2019

Maybe the pretrained in the configs isn’t suitable,you can try the default configuration in the section of the pretrained.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Poor model performance on certain out-of-sample data
1 Answer 1 · Oversampling/undersampling - creating a new dataset which doesn't have the imbalance problem, therefore forcing the model to contend ...
Read more >
How to Solve Data Loading Bottlenecks in Your Deep ...
Load (read) all dataset into RAM at the beginning of the training so that there will be no time consumed reading from the...
Read more >
Direct Query custom column and poor performance on...
Direct Query custom column and poor performance on large dataset ... get the data needed, and in Import data mode, the whole dataset...
Read more >
How to improve the performance of CNN Model for a specific ...
Increase the dataset size. Neural networks rely on loads of good training data to learn patterns from. · Lower the learning rate. This...
Read more >
Evaluating models | AutoML Tables - Google Cloud
Poor performance ; Perfect performance ... After training a model, AutoML Tables uses the test dataset to evaluate the quality and accuracy of...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found