Feature: integration standard libraries

Create a uniform integration for metrics libraries such as scikit-learn, keras.metrics or torchmetrics instead of integrating them metrics from these frameworks one-by-one. The goal of the integration is to be able to load the metrics from these frameworks with a syntax as follows:

accuracy = load_metric("scikit-learn/accuracy")

This way there is also more transparency where the metrics come from especially if they are just a wrapper around existing libraries. This would also simplify maintaining them by avoiding the need to change every metric separately if needed.

Popular metrics libraries:

• scikit-learn
• keras.metrics
• torchmetrics

Others (maybe a bit more niche):

• PyDML
• networkX
• MLFlow

If all metrics (incl. “canonical” ones) will be on the hub such an integration could just be a script that automatically creates (or updates) the necessary repositories on the hub.

[sashavor]

And to Skimage

[sashavor]

We could also connect to GEM as per @yjernite 's proposal in another thread.