Med Journal Clinical Trial Reports Ignore Risks

by GoozNews ~ 27 Oct 2009 08:14am

Accurate information on harms of medical interventions is essential for evidence-based practice. Most newly introduced treatments usually have small, incremental benefits, if any, against already available interventions, and differences in the profile of harms should play a key role on treatment choice.

So leads an editorial in today's edition of the Archives of Internal Medicine by John P.A. Ionannidis, the Greek physician-researcher most famous for his 2005 article in PLoS Medicine that explained "why most research findings are false." His editorial was in response to a new study showing how authors in major medical journals often ignore risk information when reporting clinical trial results. The study, reported by MedPage Today here, found 47 percent of 133 trials reported in journals like the New England Journal of Medicine, the Journal of the American Medical Association, the British Medical Journal and Lancet omitted numbers of study withdrawals because of adverse effects, while 27 percent failed to describe the seriousness of the adverse effects that were observed.

Why? "Perhaps conflicts of interest and marketing rather than science have shaped even the often accepted standard that randomized trials study primarily effectiveness," Ionannidis concludes, "whereas information on harms from medical interventions can wait for case reports and nonrandomized studies."

That just won't do, he says. "Nonrandomized data are very helpful, but they have limitations, and many harms will remain long undetected if we just wait for spontaneous reporting and other nonrandomized research to reveal them. In an environment where effectiveness benefits are small and shrinking, the randomized trials agenda may need to reprogram its whole mission, including its reporting, toward better understanding of harms." 

Comments

John P.A. Ionannidis is also

John P.A. Ionannidis is also noted for his 2007 article in The Oncologist, "Is Molecular Profiling Ready for Use in Clinical Decision Making?" When microarrays and high throughput RT-PCR emerged some years back, you'd think that there would be quite a bit of progress by now. Sad to say, there has not. There was nothing presented at the recent 2009 American Society of Clinical Oncology Breast Cancer Symposium which reports any progress at all in drug selection through the use of molecular profiling.

Less than 20 percent of registered clinical trials of cancer drugs are eventually published in medical journals, according to a review published online by the The Oncologist medical journal.

A search of the National Institutes of Health's ClinicalTrials.gov web site identified 2,028 registered research studies of cancer treatments. Major medical journals require all studies considered for publication be registered at ClinicalTrials.gov or another publicly accessible database.

And a subsequent search of the National Library of Medicine's PubMed database showed that just 17.6 percent of the trials were eventually published in peer-reviewed medical journals.

The publication rate was particularly low for industry-sponsored studies, such as those funded by drugmakers (just 5.9% compared to 59% for studies sponsored by collaborative research networks. Of published studies, nearly two-thirds had positive results in that the treatment worked as hoped. The remaining one-third had negative results like the outcome was disappointing or did not merit further consideration of the tested treatment, they report.

The finding raises concern about publication bias in cancer treatment trials, according to the researchers, Scott Ramsey and John Scoggins of University of Washington and Fred Hutchinson Cancer Research Center in Seattle.

The researchers suspect the rate of negative results is much higher in the studies that have gone unpublished. "It is likely that many unpublished studies contain important information that could influence future research and present practice policy," they wrote.

Of course, we know why a registered trial may not be published, some fail and a researcher may decide the result doesn't enhance knowledge or one's reputation. And some sponsors don't want negative results out there. Same goes for some journal editors.

But "unpublished trials may have special importance in oncology, due to the toxicity and/or expense of many therapies," they wrote. In other words, the knowledge base is incomplete. And who does that help?