Implement more separation metrics
See original GitHub issueAlthough bss_eval
is pretty standard, there are more:
http://bass-db.gforge.inria.fr/peass/
http://labrosa.ee.columbia.edu/projects/snreval/
Issue Analytics
- State:
- Created 9 years ago
- Comments:29 (19 by maintainers)
Top Results From Across the Web
Separating Your Metrics and KPIs: What They Are and How ...
Separating your metrics from your KPIs will help to give you a strategic advantage on those organisations unable to tell the difference.
Read more >Metrics for evaluating concern separation and composition
This paper discusses an approach to evaluating the separa-tion of concerns for an object-oriented software system.
Read more >Class Separation based Machine Learning Model ... - Mawazo
The class Separation metric will have a large value in such cases,which is a desirable property of the model.
Read more >Cyber Metrics: Six Degrees of Separation? - LinkedIn
One example is measuring cybersecurity performance based on one-dimensional criteria such as 'number of threats detected' rather on more nuanced ...
Read more >Data Distribution and Separation (Routing to Multiple Backends)
Do you need to build an even more complex backend infrastructure for that? ... data to a specific group or to implement a...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
My $2e-2: i think it makes sense to have a self-contained
bsseval
package and either deprecate the implementation inmir_eval
, or refactor it to depend on thebsseval
implementation. A few arguments for this:Thanks for your feedback. I think wrapping around
bsseval
makes sense. The currentmuseval
is actually quite close to the eval pipeline ofmir_eval
with respect to the metric artifacts. We then would include amir_eval
api compatibility layer so that using bsseval could be a drop-in replacement formir_eval.separation.evaluate
.Now we need to work on
bsseval
to match the rigor ofmir_eval
with respect to testing and code coverage – especially regression tests. I will get back to you here when we are done.