The Flaws of Academic Statistics: the Null Ritual
About this episode
Nearly every academic paper published since the 1960s has used statistics known to be faulty.
That sounds extreme, but it's actually not even controversial in the statistical literature.
In the 1950s, Ronald Fisher invented a statistical technique to solve the philosophical Problem of Induction. Neyman and Pearson developed a technique for statistical quality control in factories. Yet somehow, these two techniques were confused and merged into the Null Ritual of today, which is the neurotic pattern that every paper in many disciplines have to follow.
The Null Ritual is one of the clearest examples of academic consensus so far off the tracks that scholar treat the techniques in textbooks were religious devotion, rather than with critical awareness of what they are actually supposed to be. The end result? Nearly every field is rife with misuse of numbers, publication bias, misunderstandings and fake conclusions.
📚 See readings and other media.
Note that pay-walled academic articles may be obtained by feeding their URLs to sites like Sci-Hub.
- Rationality for Mortals (Gerd Gigerenzer)
- Mindless statistics (Gerd Gigerenzer)
- Statistical Methods and Scientific Induction (Ronald Fisher)
- "Inductive Behavior" as a Basic Concept of Philosophy of Science (Jerzy Neyman)
- Inductive Inference or Inductive Behavior: Fisher and Neyman: Pearson Approaches to Statistical Testing in Psychological Research (1940-1960) (Peter Halpin and Henderikus Stam)
- Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing (Jose Perezgonzalez)
- Why Most Published Research Findings Are False: Author's Reply to Goodman and Greenland (John Ioannidis)
- Replication, statistical consistency, and publication bias (Gregory Francis)
- "Positive" Results Increase Down the Hierarchy of the Sciences. (Daniele Fanelli)
- A Short Note on P-Value Hacking (Nassim Taleb)
More...
- The Not Related! website: notrelated.xyz
- Donations will be read in the middle of each episode: donate.notrelated.xyz
Get every episode summarized
Each time Not Related! A Big-Braned Podcast publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Not Related! A Big-Braned Podcast
Overpopulation and the Mouse Metaverse
Not Related! A Big-Braned Podcast
The Economy Is Fake, the Jobs Are Fake, the Money Is Fake
Not Related! A Big-Braned Podcast
Popper, Soros and the Open Society
Not Related! A Big-Braned Podcast
Myth as Science and Prehistoric Knowledge: Hamlet's Mill
Not Related! A Big-Braned Podcast