Research: RESCH, ERNST and GARRO

Listed in Issue 56

Abstract

RESCH, ERNST and GARROW, Forschungsinstitute fur Balneologie und Kuortwissenschaft, Bad Elster, Germany conducted a clinical trial of reviewer bias against an unconventional medicine.

Background

The study was designed to test the hypothesis that experts who review papers for publications are prejudiced against unconventional therapies.

Methodology

Two versions of a 'short report' (A and B) were produced concerning the treatment of obesity. Reports A and B were identical except for the nature of the invention with version A related to a conventional treatment and version B to an unconventional treatment. Three hundred and ninety-eight reviewers were randomized to receive one or other of the reviews for peer review. The primary outcome measures were the reviewers rating of importance (scale1-5) and their verdict regarding rejection or acceptance of the paper.

Results

The overall response rate was 41% and 141 assessment forms were suitable for statistical analysis. There was a statistically significant difference in favour of the orthodox version with an odds ratio of 3.01 (95% confidence interval, 1.03 to 8.25). The medians and interquartile ranges measured on the visual analogue scale mirrored this result with of 67% (51%-78.5%) for version A and 57% (29.7%-72.6%) for version B.

Conclusion

Reviewers showed a significant albeit small bias in favour of the orthodox paper and therefore authors of technically good, unconventional papers may be at a disadvantage in the peer review process.

References

Resch KI et al. A randomised controlled study of reviewer bias against an unconventional therapy. Journal of the Royal Society of Medicine 93(4): 164-7. Apr 2000 .

ICAN 2024 Skyscraper

Scientific and Medical Network 2

Cycle Around the World for Charity 2023

Climb Mount Kilimanjaro Charity 2023

top of the page