Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

p-value in the `summary` has a cap of 0.5

See original GitHub issue

Hi, thanks for making this nice package!

Small question regarding the p-value from summary: From the doc here , it seems the range of p-value is from 0 to 1.

But when trying to use the package and checking the p-value from summary, it seems the cap of p-value is 0.5?

Issue Analytics

State:
Created a year ago
Comments:5 (2 by maintainers)

Top GitHub Comments

1reaction

WillianFukscommented, Jul 1, 2022

The p-value has the same definition as in statistics. It represents the likelihood of obtaining the observed results supposing the null-hypothesis is true, in other words, if p=0.5 it means there’s a 50% chance of observing the post-intervention period when there’s actually no impact. As the value is high then we don’t consider that there was a meaningful impact from the intervention.

But if you run the same test and find p=0, that means that the chance of observing the results by random chance without the intervention is effectively zero. In this case, as the response is considered too far away from what is normally expected, we then consider that there was a meaningful impact.

So in a nutshell it’s really the usual definition of p-statistics as defined in the literature.

0reactions

marguegitcommented, Jul 5, 2022

Thank you @WillianFuks !

Top Results From Across the Web

0.05 or 0.005? P-value Wars Continue

A p-value of 0.005 means there is a 0.5% chance – or a change from 1/20 to 1/200.

Using P-values to make conclusions (article) - Khan Academy

Sure! The p-value is the probability of a statistic at least as deviant as ours occurring under the assumption that the null hypothesis...

5.4 - p-values | STAT 200

The p-value is the proportion of samples on the randomization distribution that are more extreme than our observed sample in the direction of...

P-Value and Statistical Significance - Simply Psychology

A p-value less than 0.05 (typically ≤ 0.05) is statistically significant. It indicates strong evidence against the null hypothesis, as there is less...

P-value - Wikipedia

A very small p-value means that such an extreme observed outcome would be very unlikely under the null hypothesis. Reporting p-values of statistical...