Wenzhe Jiang
Nov 1 · 1 min read

I meant it’s not the probability that the alternative hypothesis is true, which is the mistake the author had made:

From the author:

“ This statistical test returns us something called the p-value, which tells us what is the probability that we sample the two set of samples A and B from the same distribution. Usually, we say two distributions are different when the p-value is lower than 0.05, meaning that there’s a 5% probability (very low) that we randomly get the two set of samples A and B from the same distribution.”

This is absolutely wrong. A p-value of 5% does not mean the probability that H1 is true.

    Wenzhe Jiang

    Written by