Can we automate expert-based journal rankings? : analysis of the Finnish publication indicator
Saarela, M., & Kärkkäinen, T. (2020). Can we automate expert-based journal rankings? : analysis of the Finnish publication indicator. Journal of Informetrics, 14(2), Article 101008. https://doi.org/10.1016/j.joi.2020.101008
Published inJournal of Informetrics
Embargoed until: 2022-06-01Request copy from author
© 2020 Published by Elsevier Ltd.
The publication indicator of the Finnish research funding system is based on a manual ranking of scholarly publication channels. These ranks, which represent the evaluated quality of the channels, are continuously kept up to date and thoroughly reevaluated every four years by groups of nominated scholars belonging to different disciplinary panels. This expert-based decision-making process is informed by available citation-based metrics and other relevant metadata characterizing the publication channels. The purpose of this paper is to introduce various approaches that can explain the basis and evolution of the quality of publication channels, i.e., ranks. This is important for the academic community, whose research work is being governed using the system. Data-based models that, with sufficient accuracy, explain the level of or changes in ranks provide assistance to the panels in their multi-objective decision making, thus suggesting and supporting the need to use more cost-effective, automated ranking mechanisms. The analysis relies on novel advances in machine learning systems for classification and predictive analysis, with special emphasis on local and global feature importance techniques. ...
Publication in research information system
MetadataShow full item record
Related funder(s)Academy of Finland
Funding program(s)Research profiles, AoF; Academy Programme, AoF
Additional information about fundingThis research was supported by the Academy of Finland (grants no. 315550 and 311877) and is related to the thematic research area DEMO (Decision Analytics Utilizing Causal Models and Multiobjective Optimization, jyu.fi/demo) of the University of Jyväskylä.
Showing items with similar title or keywords.
Akusok, Anton; Saarela, Mirka; Kärkkäinen, Tommi; Björk, Kaj-Mikael; Lendasse, Amaury (Springer International Publishing, 2019)The paper proposes to analyze a data set of Finnish ranks of academic publication channels with Extreme Learning Machine (ELM). The purpose is to introduce and test recently proposed ELM-based mislabel detection approach ...
Original data for article Kotimaiset tieteelliset julkaisusarjat ja avoimuus (Finnish scientific journals and their openness) Ylönen, Irene; Anna-Kaarina Linna; Mika Holopainen; Ikonen, ArtoInformation on openness, green open access and copyrights of Finnish scientific journals ranked on levels 1-3 (Jufo classification). Data consists of 336 journals and their policies on open science, open access and ...
Hanafizadeh, Payam; Shaikh, Aijaz (Elsevier, 2021)A growing body of knowledge has confirmed that the journal peer-review process is an integral part of the scientific publication process and provides demonstrable benefits to journal editors and authors. This study aims ...
Following the money? : Performance based funding and the changing publication patterns of Finnish academics Mathies II, Charles; Kivistö, Jussi; Birnbaum, Matthew (Springer, 2020)Research on how performance-based funding influences the behaviour and performance of academics is limited in Europe. In this study, we investigate the changing publication patterns among Finnish academics associated with ...
Ojala, Jari; Hemminki, Tiina; Nevalainen, Pasi (Routledge, 2019)