Can visualization alleviate dichotomous thinking : Effects of visual representations on the cliff effect
Helske, J., Helske, S., Cooper, M., Ynnerman, A., & Besancon, L. (2021). Can visualization alleviate dichotomous thinking : Effects of visual representations on the cliff effect. IEEE Transactions on Visualization and Computer Graphics, 27(8), 3397-3409. https://doi.org/10.1109/TVCG.2021.3073466
© Authors, 2021
Common reporting styles for statistical results in scientific articles, such as \pvalues\ and confidence intervals (CI), have been reported to be prone to dichotomous interpretations, especially with respect to the null hypothesis significance testing framework. For example when the p-value is small enough or the CIs of the mean effects of a studied drug and a placebo are not overlapping, scientists tend to claim significant differences while often disregarding the magnitudes and absolute differences in the effect sizes. This type of reasoning has been shown to be potentially harmful to science. Techniques relying on the visual estimation of the strength of evidence have been recommended to reduce such dichotomous interpretations but their effectiveness has also been challenged. We ran two experiments on researchers with expertise in statistical analysis to compare several alternative representations of confidence intervals and used Bayesian multilevel models to estimate the effects of the representation styles on differences in researchers' subjective confidence in the results. We also asked the respondents' opinions and preferences in representation styles. Our results suggest that adding visual information to classic CI representation can decrease the tendency towards dichotomous interpretations measured as the cliff effect: the sudden drop in confidence around p-value 0.05 compared with classic CI visualization and textual representation of the CI with p-values. All data and analyses are publicly available at https://github.com/helske/statvis. ...
Dataset(s) related to the publicationhttps://github.com/helske/statvis
Publication in research information system
MetadataShow full item record
Related funder(s)Academy of Finland
Funding program(s)Academy Project, AoF; Research profiles, AoF
Additional information about fundingJ. Helske was supported by Academy of Finland grants 311877 and 331817. S. Helske was supported by the Academy of Finland (331816, 320162) and the Swedish ResearchCouncil (445-2013-7681, 340-2013-5460).
Showing items with similar title or keywords.
Kotamäki, Niina (University of Jyväskylä, 2018)Decision-making at different phases of adaptive river basin management planning rely largely on the information that is gained through environmental monitoring. The aim of this thesis was to develop and test statistical ...
Myllymäki, Mari (University of Jyväskylä, 2009)
Vihola, Matti; Helske, Jouni; Franks, Jordan (Wiley-Blackwell, 2020)We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the ...
Identifying territories using presence-only citizen science data : An application to the Finnish wolf population Karppinen, Santeri; Rajala, Tuomas; Mäntyniemi, Samu; Kojola, Ilpo; Vihola, Matti (Elsevier BV, 2022)Citizens, community groups and local institutions participate in voluntary biological monitoring of population status and trends by providing species data e.g. for regulations and conservation. Sophisticated statistical ...
Pasanen, Tiia‐Maria; Voutilainen, Miikka; Helske, Jouni; Högmander, Harri (Wiley-Blackwell, 2022)We develop a Bayesian spatio-temporal model to study pre-industrial grain market integration during the Finnish famine of the 1860s. Our model takes into account several problematic features often present when analysing ...