You are here
Are we expressing uncertainty of our claims enough? Towards automatic detection of overstatement of claims.
We data-extracted 100 randomized trials from a sample of recent Cochrane Collaboration reviews. For us this was efficient because these trials had already been assessed for their methodological robustness through Cochrane’s ‘risk of bias’ scale. We extracted outcome data on main results of all trials and their statistical precision (via its standard error). Then, dedicated software determined hedging scores automatically.  These hedging score were normalized to account for a paper’s word-count. We determined 10th
and 90th centile normalized hedging scores and related these to (1 minus) the risk-of-bias scores (study quality).