question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Implement more separation metrics

See original GitHub issue

Issue Analytics

  • State:open
  • Created 9 years ago
  • Comments:29 (19 by maintainers)

github_iconTop GitHub Comments

4reactions
bmcfeecommented, May 23, 2019

My $2e-2: i think it makes sense to have a self-contained bsseval package and either deprecate the implementation in mir_eval, or refactor it to depend on the bsseval implementation. A few arguments for this:

  1. Google-ability, as mentioned above.
  2. It’s the only functionality in mir_eval that depends on audio signal processing (not counting sonification), and has always been a bit of an odd one out.
  3. Potentially wider adoption / more maintainers. The bss eval metrics in mir_eval are somewhat baroque (to maintain compatibility with the matlab package), and AFAIK we don’t really have a dedicated maintainer for that at this point. I’ve spent enough time in the guts of this module to know what a pain it is to get right (BLAS dependencies, anyone?), so anything we can do to increase participation / maintainership is a good thing IMO.
3reactions
faroitcommented, Jun 4, 2019

Thanks for your feedback. I think wrapping around bsseval makes sense. The current museval is actually quite close to the eval pipeline of mir_eval with respect to the metric artifacts. We then would include a mir_eval api compatibility layer so that using bsseval could be a drop-in replacement for mir_eval.separation.evaluate.

Now we need to work on bssevalto match the rigor of mir_eval with respect to testing and code coverage – especially regression tests. I will get back to you here when we are done.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Separating Your Metrics and KPIs: What They Are and How ...
Separating your metrics from your KPIs will help to give you a strategic advantage on those organisations unable to tell the difference.
Read more >
Metrics for evaluating concern separation and composition
This paper discusses an approach to evaluating the separa-tion of concerns for an object-oriented software system.
Read more >
Class Separation based Machine Learning Model ... - Mawazo
The class Separation metric will have a large value in such cases,which is a desirable property of the model.
Read more >
Cyber Metrics: Six Degrees of Separation? - LinkedIn
One example is measuring cybersecurity performance based on one-dimensional criteria such as 'number of threats detected' rather on more nuanced ...
Read more >
Data Distribution and Separation (Routing to Multiple Backends)
Do you need to build an even more complex backend infrastructure for that? ... data to a specific group or to implement a...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found