Automatic content analysis in collaborative inquiry-based learning
Espinoza, C., Lämsä, J., Araya, R., Hämäläinen, R., Jimenez, A., Gormaz, R., & Viiri, J. (2019). Automatic content analysis in collaborative inquiry-based learning. In O. Levrini, & G. Tasquier (Eds.), Proceedings of ESERA 2019 : The Beauty and Pleasure of Understanding : Engaging with Contemporary Challenges Through Science Education (pp. 2041-2050). University of Bologna. https://www.esera.org/publications/esera-conference-proceedings/esera-2019
© 2019 ESERA and the Authors
In the field of science education, content analysis is a popular way to analyse collaborative inquiry-based learning (CIBL) processes. However, content analysis is time-consuming when conducted by humans. In this paper, we introduce an automatic content analysis method to identify the different inquiry-based learning (IBL) phases from authentic student face-to-face discussions. We illustrate the potential of automatic content analysis by comparing the results of manual content analysis (conducted by humans) and automatic content analysis (conducted by computers). Both the manual and automatic content analyses were based on manual transcriptions of 11 groups’ CIBL processes. Two researchers performed the manual content analysis, in which each utterance of the groups’ discussions was coded to an IBL phase. First, an algorithm was trained with some of the manually coded utterances to prepare the automatic content analysis. Second, the researchers tested the ability of the algorithm to automatically code the utterances that were not used in the training. The algorithm was a linear support vector machine (SVM) classifier. Since the input of the SVM must be a numerical vector of constant size, we used a topic model to build a feature vector representation for each utterance. The correspondence of the manual and automatic content analyses was 52.9%. The precision of the classifier varied from 49% to 68%, depending on the IBL phase. We discuss issues to consider in the future when improving automatic content analysis methods. We also highlight the potential benefits of automatic content analysis from the viewpoint of science teachers and science education researchers ...
PublisherUniversity of Bologna
Parent publication ISBN978-88-945874-0-1
ConferenceEuropean Science Education Research Association Conference
Is part of publicationProceedings of ESERA 2019 : The Beauty and Pleasure of Understanding : Engaging with Contemporary Challenges Through Science Education
Publication in research information system
MetadataShow full item record
Related funder(s)Academy of Finland
Funding program(s)Research profiles, AoF
Additional information about fundingSuomen Akatemia 292466 ja 318095 (the Multidisciplinary Research on Learning and Teaching profiles I and II of JYU)
Showing items with similar title or keywords.
Deep Networks for Collaboration Analytics : Promoting Automatic Analysis of Face-to-Face Interaction in the Context of Inquiry-Based Learning Lämsä, Joni; Uribe, Pablo; Jiménez, Abelino; Caballero, Daniela; Hämäläinen, Raija; Araya, Roberto (Society for Learning Analytics Research, 2021)Scholars have applied automatic content analysis to study computer-mediated communication in computer-supported collaborative learning (CSCL). Since CSCL also takes place in face-to-face interactions, we studied the automatic ...
The potential of temporal analysis : Combining log data and lag sequential analysis to investigate temporal differences between scaffolded and non-scaffolded group inquiry-based learning processes Lämsä, Joni; Hämäläinen, Raija; Koskinen, Pekka; Viiri, Jouni; Mannonen, Joonas (Elsevier, 2020)This paper contributes to the ongoing discussion about analysing the temporal aspects of learning processes in the educational technology research field. Our main aim was to advance methods for analysing temporal aspects ...
Automatic Content Analysis of Computer-Supported Collaborative Inquiry-Based Learning Using Deep Networks and Attention Mechanisms Uribe, Pablo; Jiménez, Abelino; Araya, Roberto; Lämsä, Joni; Hämäläinen, Raija; Viiri, Jouni (Springer International Publishing, 2020)Computer-supported collaborative inquiry-based learning (CSCIL) represents a form of active learning in which students jointly pose questions and investigate them in technology-enhanced settings. Scaffolds can enhance CSCIL ...
Pöysä-Tarhonen, Johanna; Care, Esther; Awwal, Nafisa; Häkkinen, Päivi (World Scientific Publishing Co Pte Ltd., 2018)This exploratory case study focuses on how pairs of students can build a shared understanding and acquire collaborative problem-solving (CPS) practices during an online assessment of CPS skills, which is seen in the ...
Case-based Portraits of Contrasting Micro-Interaction Processes During Online Assessment of Collaborative Problem Solving Pöysä-Tarhonen, Johanna; Care, Esther; Awwal, Nafisa; Häkkinen, Päivi (Asia-Pacific Society for Computers in Education, 2017)This study recognizes the role and the quality of social aspects in collaborative problem solving (CPS) processes and outcomes. The aim of this study, relying on multiple data and phases of analysis, is to explore and ...