Table 1From “What is statistical conclusion validity? A significant result can still be wrong”
What does statistical conclusion validity mean?
Table 1What does statistical conclusion validity mean?
| Object | Question | What it cannot carry alone |
|---|---|---|
| Estimate | How large is the observed difference or association? | Importance or causality |
| Confidence interval | Which values remain compatible with the stated procedure? | Probability that a particular value is true |
| p value | How discordant are these data under the specified null model? | Probability that the null is true |
| Power or information | Could the design detect the declared effect under its assumptions? | Proof that an undetected effect is absent |
| Testing family | How many hypotheses, outcomes, or specifications were examined? | A universal correction independent of the analysis plan |
| Conclusion | What sentence does the evidence permit? | Claims outside the population, model, or outcome |
Swipe or scroll horizontally if the table is wider than your screen.
Source: Table from this essay. Sources and interpretation are given in the article.

From the essay
From the research bench
What is statistical conclusion validity? A significant result can still be wrong
Statistical conclusion validity asks whether the data and model warrant the stated result. Check effect, uncertainty, power, and testing before deciding.
Read the essayThis exhibit belongs to an essay: the numbers live here, the argument lives there.
Cite or embed
Related exhibits

Figure 1Figure
The synthetic statistical-inference review
What is statistical conclusion validity? A significant result can still be wrong

Table 1Table
What does claim entailment mean?
What is claim entailment? Does the source support the sentence?

Table 1Table
What does data lineage mean?
What is data lineage? The transformations behind a result
Contact
Bring the question you're working on.
Research, a guest lecture, or a commercial question.