question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Implement RMSE (root-mean-square error) metric and scorer

See original GitHub issue

RMSE seems to be a popular metric but now one has to calculate it through np.sqrt(mean_squared_error(XXX, XXX)). Maybe we can add squared option to mean_squared_error and add a scorer neg_root_mean_squared_error. Wiki page: https://en.wikipedia.org/wiki/Root-mean-square_deviation

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:2
  • Comments:11 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
qinhanmin2014commented, Jan 2, 2019

As the square root is a monotonic function on the positive domain, taking the square root would have no effect on any model selection

This is why we reject it previously I think (though I’m unable to find relevant discussions) I’d argue that given the popularity of RMSE, it might be worthwhile to add several lines of (redundant) code for it (we only need <5 lines of code for the metric I think) Sometimes users might want to report the RMSE of their model instead of MSE, because RMSE is more meaningful (i.e., it reflects the deviation between actual value and predicted value).

0reactions
linehammercommented, Jun 8, 2021

Mean Squared Error ( MSE ) is defined as Mean or Average of the square of the difference between actual and estimated values. This means that MSE is calculated by the square of the difference between the predicted and actual target variables, divided by the number of data points. It is always non–negative values and close to zero are better.

Root Mean Squared Error is the square root of Mean Squared Error (MSE). This is the same as Mean Squared Error (MSE) but the root of the value is considered while determining the accuracy of the model.

Read more comments on GitHub >

github_iconTop Results From Across the Web

RMSE - Root Mean Square Error in Python - AskPython
In this article, we will be focusing on Implementing RMSE - Root Mean Square Error as a metric in Python. So, let us...
Read more >
RMSE: Root Mean Square Error - Statistics How To
Root Mean Square Error (RMSE) is the standard deviation of the residuals (prediction errors). Residuals are a measure of how far from the...
Read more >
How to Interpret Root Mean Square Error (RMSE) - Statology
This tutorial explains how to interpret the root mean squared error (RMSE) of a regression model, including an example.
Read more >
Root Mean Square Error (RMSE) - C3 AI
How C3 AI Helps Organizations Use Root Mean Square Error (RMSE) ... automatically calculate RMSE and other evaluation metrics as part of a...
Read more >
Root-mean-square error (RMSE) or mean absolute error (MAE)
Root-mean-square error (RMSE) or mean absolute error (MAE): when to use ... Neither metric is inherently better: RMSE is optimal for normal ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found