question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Why training starts with extremely high accuracy?

See original GitHub issue
2019-05-17 13:18:50,651 - INFO - Epoch [1][50/32058]	lr: 0.00199, eta: 13 days, 10:51:24, time: 0.755, data_time: 0.018, memory: 5706, loss_rpn_cls: 0.4750, loss_rpn_reg: 0.0318, loss_cls: 0.1646, acc: 96.1250, loss_reg: 0.0419, loss_mask: 0.8765, loss: 1.5897
2019-05-17 13:19:29,251 - INFO - Epoch [1][100/32058]	lr: 0.00233, eta: 13 days, 14:24:12, time: 0.772, data_time: 0.015, memory: 5706, loss_rpn_cls: 0.1524, loss_rpn_reg: 0.0362, loss_cls: 0.1496, acc: 96.0703, loss_reg: 0.0888, loss_mask: 0.6807, loss: 1.1078

As you can see, the accuracy is almost 100% at the start. Why?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:7 (2 by maintainers)

github_iconTop GitHub Comments

5reactions
panjianningcommented, Apr 9, 2020

Most are negative samples.

Maybe I have a misunderstanding.

But I think the ratio of positive and negative samples should be 50:50?

image

The MaxIoUAssigner will assigned bboxes as postive, negitive or ignored samples according to the iou setting. Then, the RandomSampler will sample some bboxes for training according to the assign result.

Num=256 means it will sample 256 samples, pos_fracion=0.5 means it will TRY to make pos:neg=1:1. But more often than not, there are not enough positive bboxes. (here, we need 128), so the actual ratio MAY BE something like 2:254.

1reaction
hellockcommented, May 17, 2019

Most are negative samples.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Accuracy too high too fast? [closed]
It can be normal and there might be nothing wrong with your model. If there is a very strong and clear correlation in...
Read more >
Why is my accuracy high from the beginning of training?
It makes perfect sense that the model learns to use only that feature. So the model does NOT behave randomly. But this feature...
Read more >
100 % Accuracy: Supremacy or Imperfection (Overfitting Vs ...
The answer is “NO”. A high accuracy measured on the training set is the result of Overfitting. So, what does this overfitting means?...
Read more >
Why Do I Get Different Results Each Time in Machine Learning?
The impact is that each time the stochastic machine learning algorithm is run on the same data, it learns a slightly different model....
Read more >
Beware of an accuracy rate that is too high
In machine learning this is something that comes up time after time, you build a model, you get a great accuracy score, you...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found