Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[FEATURE] cv metrics output averages to dict

See original GitHub issue

Description

Is there an easy way to get the metric average’s from the CVResult when running an Experiment for cross validation? Is it possible to return a dictionary that has the actual averages as shown in the output print and file?

https://github.com/PreferredAI/cornac/blob/2de81e17b83794a3e7cbc4f47d6bd9061694b5d1/cornac/experiment/result.py#L76

Other Comments

Issue Analytics

State:
Created 2 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

1reaction

tqtgcommented, Feb 8, 2022

That seems reasonable, we can store mean and std as attributes of CVResult using dictionary with metrics as keys.

0reactions

deychakcommented, Feb 17, 2022

Thanks! This is great!

Top Results From Across the Web

cv - Python package - CatBoost

The cv function calculates the average of these N values and the standard ... based on the average metric value at each iteration....

sklearn.feature_selection.RFECV

A supervised learning estimator with a fit method that provides information about feature importance either through a coef_ attribute or through a ...

lightgbm.cv — LightGBM 3.3.3.99 documentation

metrics (str, list of str, or None, optional (default=None)) – Evaluation metrics to be monitored while CV. If not None, the metric in...

ExhaustiveFeatureSelector: Optimal feature sets by ...

Overview. This exhaustive feature selection algorithm is a wrapper approach for brute-force evaluation of feature subsets; the best subset is selected by ...

How to Use Metrics for Deep Learning with Keras in Python

In both cases, the name of the metric function is used as the key for ... running the example a few times and...