Human experts vs. machines in taxa recognition
Ärje, J., Raitoharju, J., Iosifidis, A., Tirronen, V., Meissner, K., Gabbouj, M., Kiranyaz, S., & Kärkkäinen, S. (2020). Human experts vs. machines in taxa recognition. Signal Processing : Image Communication, 87, Article 115917. https://doi.org/10.1016/j.image.2020.115917
Published inSignal Processing : Image Communication
Embargoed until: 2022-09-01Request copy from author
© 2020 Elsevier B.V. All rights reserved.
The step of expert taxa recognition currently slows down the response time of many bioassessments. Shifting to quicker and cheaper state-of-the-art machine learning approaches is still met with expert scepticism towards the ability and logic of machines. In our study, we investigate both the differences in accuracy and in the identification logic of taxonomic experts and machines. We propose a systematic approach utilizing deep Convolutional Neural Nets and extensively evaluate it over a multi-pose taxonomic dataset with hierarchical labels specifically created for this comparison. We also study the prediction accuracy on different ranks of taxonomic hierarchy in detail. We compare the results of Convolutional Neural Networks to human experts and support vector machines. Our results revealed that human experts using actual specimens yield the lowest classification error (CE¯=6.1%). However, a much faster, automated approach using deep Convolutional Neural Nets comes close to human accuracy (CE¯=11.4%) when a typical flat classification approach is used. Contrary to previous findings in the literature, we find that for machines following a typical flat classification approach commonly used in machine learning performs better than forcing machines to adopt a hierarchical, local per parent node approach used by human taxonomic experts (CE¯=13.8%). Finally, we publicly share our unique dataset to serve as a public benchmark dataset in this field. ...
Publication in research information system
MetadataShow full item record
Related funder(s)Academy of Finland
Funding program(s)Academy Project, AoF; Research costs of Academy Research Fellow, AoF
Additional information about fundingWe thank the Academy of Finland for the grants of Ärje (284513, 289076), Tirronen (289076, 289104) Kärkkäinen (289076), Meissner (289104), and Raitoharju (288584). We would like to thank CSC for computational resources.
Showing items with similar title or keywords.
Pölönen, Ilkka; Annala, Leevi; Rahkonen, Samuli; Nevalainen, Olli; Honkavaara, Eija; Tuominen, Sakari; Viljanen, Niko; Hakala, Teemu (IEEE, 2019)In this study we apply 3D convolutional neural network (CNN) for tree species identification. Study includes the three most common Finnish tree species. Study uses a relatively large high-resolution spectral data set, ...
Tree species classification of drone hyperspectral and RGB imagery with deep learning convolutional neural networks Nezami, Somayeh; Khoramshahi, Ehsan; Nevalainen, Olli; Pölönen, Ilkka; Honkavaara, Eija (MDPI AG, 2020)Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include ...
Li, Fan; Tang, Hong; Shang, Shang; Mathiak, Klaus; Cong, Fengyu (MDPI, 2020)Heart sounds play an important role in the diagnosis of cardiac conditions. Due to the low signal-to-noise ratio (SNR), it is problematic and time-consuming for experts to discriminate different kinds of heart sounds. Thus, ...
Zeeshan, Khaula (2018)Syvä oppiminen (engl. deep learning) on viime aikoina tullut suosituimmaksi koneoppimisen menetelmäksi. Konvoluutio(hermo)verkko on yksi suosituimmista syvän oppimisen arkkitehtuureista monimutkaisiin ongelmiin kuten kuvien ...
Raitoharju, Jenni; Riabchenko, Ekaterina; Ahmad, Iftikhar; Iosifidis, Alexandros; Gabbouj, Moncef; Kiranyaz, Serkan; Tirronen, Ville; Ärje, Johanna; Kärkkäinen, Salme; Meissner, Kristian (Elsevier BV, 2018)Managing the water quality of freshwaters is a crucial task worldwide. One of the most used methods to biomonitor water quality is to sample benthic macroinvertebrate communities, in particular to examine the presence and ...