Subscribe now

Mathematics

The maths that tells us when a scientific discovery is real – or not

When huge scientific discoveries are made, you may hear that they are “statistically significant” or pass a threshold called “5 sigma” – but those calculations can be manipulated to make claims seem grander than they are, finds Jacob Aron

By Jacob Aron

8 May 2025

 

The most common tools for assessing the rarity of a finding still require plenty of assumptions

Shutterstock / Kenishirotie

Terry Pratchett was fond of saying that million-to-one chances crop up nine times out of ten. On the face of it, this sentence is mathematically absurd, but in the fantasy world of Pratchett’s Discworld books, powered by the magic of narratives, it makes perfect sense. Of course heroes are always going to face incredible odds, and of course they are almost always going to overcome them, because that is what heroes do.

Sign up to our weekly newsletter

Receive a weekly dose of discovery in your inbox! We'll also keep you up to date with New Scientist events and special offers.

Sign up

To continue reading, subscribe today with our introductory offers

Piano Exit Overlay Banner Mobile Piano Exit Overlay Banner Desktop