Only One In Ten Medical Treatments Are Backed By High-Quality Evidence — University Of Oxford By Jeremy Howick, University of Oxford for Natural Blaze
When you visit your doctor, you might assume that the treatment they prescribe has solid evidence to back it up. But you’d be wrong. Only one in ten medical treatments are supported by high-quality evidence, our latest research shows.
The analysis, which is published in the Journal of Clinical Epidemiology, included 154 Cochrane systematic reviews published between 2015 and 2019. Only 15 (9.9%) had high-quality evidence according to the gold-standard method for determining whether they provide high or low-quality evidence, called GRADE (grading of recommendations, assessment, development and evaluation). Among these, only two had statistically significant results – meaning that the results were unlikely to have arisen due to random error – and were believed by the review authors to be useful in clinical practice. Using the same system, 37% had moderate, 31% had low, and 22% had very low-quality evidence.
The GRADE system looks at things like risk of bias. For example, studies that are “blinded” – in which patients don’t know whether they are getting the actual treatment or a placebo – offer higher-quality evidence than “unblinded” studies. Blinding is important because people who know what treatment they are getting can experience greater placebo effects than those who do not know what treatment they are getting.
Now is your chance to support Gospel News Network.
We love helping others and believe that’s one of the reasons we are chosen as Ambassadors of the Kingdom, to serve God’s children. We look to the Greatest Commandment as our Powering force.
Among other things, GRADE also considers whether the studies were imprecise because of differences in the way the treatment was used. In the 2016 review, researchers found that 13.5% – about one in seven – reported that treatments were supported by high-quality evidence. Lack of high-quality evidence, according to GRADE, means that future studies might overturn the results.
The 154 studies were chosen because they were updates of a previous review of 608 systematic reviews, conducted in 2016. This allows us to check whether reviews that had been updated with new evidence had higher-quality evidence. They didn’t. In the 2016 study, 13.5% reported that treatments were supported by high-quality evidence, so there was a trend towards lower quality as more evidence was gathered.
