question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[BUG] {Incorrect spatial location for Yolo detections}

See original GitHub issue

Describe the bug Bounding box of the YoloSpatialDetectionNetwork doesn’t overlap the location of the detected object, thus resulting in incorrect distance estimates, especially on the z (depth) axis.

To Reproduce Steps to reproduce the behavior:

  1. Just run the ‘RGB&TinyYolo with Spatial Data’ example from your website here:
  2. Set the bounding box factor to one, i.e. setBoundingBoxScaleFactor(1). (You can leave it as it is, but the problem will be better observed with a larger bounding box.)
  3. Place an object (a bottle, for example) that is identified by the neural network in front of the camera and observe how the bounding box in the depth image DOES NOT align with the actual object detected by the neural network.

Expected behavior The bounding box surrounding the object from the NN image should surrond the same object in the depth image.

Screenshots In the GIF attached below, you can see that the roundabout sign is correctly detected by the NN and subsequently framed in a bounding box, but in the depth image, the bounding box is to the right of the object, barely capturing some of the left margin of the object under it. This leads to incorrect depth estimation, that is dependent on the background of the object.

try3

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:2
  • Comments:12

github_iconTop GitHub Comments

2reactions
ZeicBeniamincommented, Apr 28, 2022

If the issue has already been solved in another branch/commit (though I doubt it), please paste a link here. Or if you have any suggestions as to where modifications should be made, I would greatly appreciate it, since I need to get this feature working as fast as possible. Thank you!

Read more comments on GitHub >

github_iconTop Results From Across the Web

YoloSpatialDetectionNetwork — DepthAI documentation
Spatial detection for the Yolo NN. It is similar to a combination of the YoloDetectionNetwork and SpatialLocationCalculator. How to place it¶. Python.
Read more >
Object detection using YOLO: challenges, architectural ...
An object in the image should be detected by a bounding box such that the center of the object should reside in that...
Read more >
YOLO — You only look once, real time object detection ...
We reframe object detection as a single regression problem, straight from image pixels to bounding box coordinates and class probabilities. A ...
Read more >
Real-time Object Detection with YOLO, YOLOv2 and now ...
Comparing with region based detectors, YOLO has higher localization errors and the recall (measure how good to locate all objects) is lower. YOLOv2...
Read more >
Problems of YOLOv3 model - Bio-protocol
YOLO series object detection network is the most representative network ... the loss of more spatial information, it has poor effect on object...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found