question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Overlapping Clip recordings (when multiple simultaneous events occur)

See original GitHub issue

During object detection, multiple objects can be tracked simultaneously. Each of these objects generates a unique event ID. Each of these unique event ID’s also generates its own clip independent of each other.

So, if you have 3 people walking past a camera you get three nearly identical clips (slight offsets due to when it began tracking each person). Or if the tracking loses a person and re-acquires them as a new event ID… you get multiple overlapping clips. These can compound until you have a plethora of overlapping clips being recorded and saved of the same time frame.

Just for example - I had 3 people in a room for 11 minutes. Frigate registered at one point 16 people (this is probably more to do with the configuration on my part - it lost and re-acquired them multiple times) and generated 111 clips.

Making it so that if a clip is already being generated another is not started, but instead, the clip continues until all objects are “gone” would be a great enhancement. This will be difficult though due to event ID to clip matching (many to one).

One idea (just to brainstorm as I expect this issue is more complex than I am explaining):

  1. Add a new property - clip_ID and assign it to each clip just as event_ID is for each object tracking event.
  2. When an event starts check if a clip is already being recorded.
  3. If it is, copy the clip_ID to the event_data - if not, start a new clip_ID and copy it to the event_data.

This would allow each event to be associated with the clip that contains it, and each clip could contain multiple events. I’m not sure if the database design would need to be updated or not (haven’t looked at it that closely). With the clips and events having different ID’s I expect a lot of updating would have to be done… but if the clip_ID is in the event_data maybe it won’t be horrible?

Okay, I’ll stop theorizing now… I’m happy to help with this if I can!

Cheers! DeadEnd

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

3reactions
blakeblackshearcommented, Feb 7, 2021

I implemented some duplicate removal logic in the event cleanup process that runs every 5 minutes. It groups events that started within 10 seconds of each other and removes everything but the longest one. Not perfect, but I think it covers a majority of the duplicates.

0reactions
blakeblackshearcommented, Feb 5, 2021

If the person who stopped walking and talked on the phone for 10 minutes was not in motion

I’m assuming here that they don’t quite stop moving enough, but the next version will already work this way if they stop moving.

Or even a new clip that began after max_seconds would work.

This could be interesting.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Overlapping Clips - Steinberg.help
You can move clips so that they overlap each other. Note the following: The tracks in the audio montage are polyphonic, which means...
Read more >
Use drag modes in Logic Pro - Apple Support
Overlap : Preserves the current region borders when you drag one region over another. No Overlap: When two regions overlap, the overlapped area...
Read more >
(PDF) Normalization of Partly Overlapping Audio Recordings ...
We show that normalization is trivial when all recordings share the same time support but the same process is non-trivial when the recordings...
Read more >
US9565389B2 - Systems and methods for recording overlapping ...
In many aspects, systems and methods for recording overlapping media content using interactive media guidance applications are provided.
Read more >
Arrange clips in the Expert view timeline
With multiple audio tracks, you can add a narration to one track and background music to another track. The final movie combines all...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found