Project data of ShowTell – Finnish Sign Language MoCap corpus
Jantunen, Tommi; Wainio, Tuija; Burger, Birgitta. Project data of ShowTell – Finnish Sign Language MoCap corpus. 10.17011/jyx/dataset/83520
Restricted use due to personal information protection. You can still contact author to ask for a copy of the material.
Jantunen, Tommi and University of Jyväskylä
The MoCap data s a numerical matrix of over a billion characters that was collected during 2017 in the MoCap laboratory of the Department of Music, Art and Culture Studies, JYU. The data comprises 33 narratives (total duration 21 minutes) recorded from six FinSL signers with an eight-camera optical Qualisys Oqus motion capture system connected to one Full HD 30 fps video camera. The narratives are based on short textless cartoon strips which the signers first memorized and then re-told to an addressee standing in front of them. Each signer produced at least five narratives, and each narrative included a varying amount of regular telling as well as subtle, reduced and overt constructed action. Twenty-five small reflect-ing ball-shaped markers, whose three-dimensional locations the MoCap system tracked with a speed of 120 Hz, were attached to the main body parts of all the signers. The specific locations of the mark-ers relevant to the proposed study are the proximal joints of the index fingers, the ulnar and radial side of the wrists, as well as both elbows. ...
Is part of datasetJantunen, Tommi; Puupponen, Anna; Hernández Barros, Doris; Wainio, Tuija; Keränen, Jarkko; Salonen, Juhana; Burger, Birgitta. Project data set of ShowTell – Showing and telling in Finnish Sign Language. University of Jyväskylä. https://doi.org/10.17011/jyx/dataset/89372. https://doi.org/10.17011/jyx/dataset/89371.
Publication(s) related to the dataset
- Jantunen, T., De Weerdt, D., Burger, B., & Puupponen, A. (2021). The more you move, the more action you construct : a motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives. Gesture, 19(1), 76-101. https://doi.org/10.1075/gest.19042.jan https://jyx.jyu.fi/handle/123456789/75961
- Jantunen, T., Puupponen, A., & Burger, B. (2020). What Comes First : Combining Motion Capture and Eye Tracking Data to Study the Order of Articulators in Constructed Action in Sign Language Narratives. In N. Calzolari, F. Béchet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, & S. Piperidis (Eds.), LREC 2020 : Proceedings of the 12th Conference on Language Resources and Evaluation (pp. 6003-6007). European Language Resources Association. LREC proceedings. https://www.aclweb.org/anthology/2020.lrec-1.735.pdf https://jyx.jyu.fi/handle/123456789/71022
- Jantunen, T. (2018). Viittomakielet hybridisysteemeinä : hämärärajaisuus ja epäkonventionaalisuus osana viittomakielten rakennetta. Puhe ja kieli, 38(3), 109-126. https://doi.org/10.23997/pk.77382 https://jyx.jyu.fi/handle/123456789/60952
Dataset in research information system
MetadataShow full item record
- Tutkimusdata 
Related funder(s)Academy of Finland; Suomen Akatemia
Funding program(s)Akatemiatutkijan tutkimuskulut, SA; Academy Project, AoF; Akatemiahanke, SA; Research costs of Academy Research Fellow, AoF
Showing items with similar title or keywords.
Jantunen, Tommi; Puupponen, Anna; Hernández Barros, Doris; Keränen, Jarkko; Salonen, Juhana; Burger, Birgitta (University of Jyväskylä, 2023)The research objective of the proposed project is to investigate the relationship between constructed action (showing) and regular telling (telling) from the points of view of language use, kinematics and brain-based ...
The more you move, the more action you construct : a motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives Jantunen, Tommi; De Weerdt, Danny; Burger, Birgitta; Puupponen, Anna (John Benjamins Publishing Company, 2021)This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed ...
What Comes First : Combining Motion Capture and Eye Tracking Data to Study the Order of Articulators in Constructed Action in Sign Language Narratives Jantunen, Tommi; Puupponen, Anna; Burger, Birgitta (European Language Resources Association, 2020)We use synchronized 120 fps motion capture and 50 fps eye tracking data from two native signers to investigate the temporal order in which the dominant hand, the head, the chest and the eyes start producing overt constructed ...
Salonen, Juhana; Kronqvist, Antti; Jantunen, Tommi (European Language Resources Distribution Agency, 2020)This paper presents the Corpus of Finnish Sign Language(Corpus FinSL), a structured and annotated collection of Finnish Sign Language (FinSL) videos published in May 2019 in FIN-CLARIN's Language Bank ...
Jantunen, Tommi; Puupponen, Anna; Keränen, Jarkko (University of Jyväskylä, 2023)The purpose of collecting the EEG material was to investigate the relationship between CA (showing) and RT (telling) from the point of view of brain-based cognitive processing of meaning in Finnish Sign Language. The EEG ...