What Comes First : Combining Motion Capture and Eye Tracking Data to Study the Order of Articulators in Constructed Action in Sign Language Narratives
Jantunen, T., Puupponen, A., & Burger, B. (2020). What Comes First : Combining Motion Capture and Eye Tracking Data to Study the Order of Articulators in Constructed Action in Sign Language Narratives. In N. Calzolari, F. Béchet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, & S. Piperidis (Eds.), LREC 2020 : Proceedings of the 12th Conference on Language Resources and Evaluation (pp. 6003-6007). European Language Resources Association. LREC proceedings. https://www.aclweb.org/anthology/2020.lrec-1.735.pdf
Julkaistu sarjassa
LREC proceedingsToimittajat
Päivämäärä
2020Tekijänoikeudet
© European Language Resources Association (ELRA)
We use synchronized 120 fps motion capture and 50 fps eye tracking data from two native signers to investigate the temporal order in which the dominant hand, the head, the chest and the eyes start producing overt constructed action from regular narration in seven short Finnish Sign Language stories. From the material, we derive a sample of ten instances of regular narration to overt constructed action transfers in ELAN which we then further process and analyze in Matlab. The results indicate that the temporal order of articulators shows both contextual and individual variation but that there are also repeated patterns which are similar across all the analyzed sequences and signers. Most notably, when the discourse strategy changes from regular narration to overt constructed action, the head and the eyes tend to take the leading role, and the chest and the dominant hand tend to start acting last. Consequences of the findings are discussed.
Julkaisija
European Language Resources AssociationEmojulkaisun ISBN
979-10-95546-34-4Konferenssi
International Conference on Language Resources and EvaluationKuuluu julkaisuun
LREC 2020 : Proceedings of the 12th Conference on Language Resources and EvaluationISSN Hae Julkaisufoorumista
2522-2686Asiasanat
Alkuperäislähde
https://www.aclweb.org/anthology/2020.lrec-1.735.pdfJulkaisuun liittyvä(t) tutkimusaineisto(t)
Jantunen, Tommi; Wainio, Tuija; Burger, Birgitta. (2022). Project data of ShowTell – Finnish Sign Language MoCap corpus. University of Jyväskylä. https://doi.org/10.17011/jyx/dataset/83520. https://urn.fi/URN:NBN:fi:jyu-202210124845Julkaisu tutkimustietojärjestelmässä
https://converis.jyu.fi/converis/portal/detail/Publication/36243546
Metadata
Näytä kaikki kuvailutiedotKokoelmat
Rahoittaja(t)
Suomen AkatemiaRahoitusohjelmat(t)
Akatemiatutkijan tutkimuskulut, SA; Akatemiatutkija, SA; Tutkijatohtori, SALisätietoja rahoituksesta
The study was financed by the Academy of Finland under grants 269089 & 304034 (TJ) and 299067 (BB).Lisenssi
Samankaltainen aineisto
Näytetään aineistoja, joilla on samankaltainen nimeke tai asiasanat.
-
The more you move, the more action you construct : a motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives
Jantunen, Tommi; De Weerdt, Danny; Burger, Birgitta; Puupponen, Anna (John Benjamins Publishing Company, 2021)This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed ... -
Variation in the use of constructed action according to discourse type and age in Finnish Sign Language
Puupponen, Anna; Kanto, Laura; Wainio, Tuija; Jantunen, Tommi (Elsevier BV, 2022)This paper presents a study of the use of constructed action (CA) in the stories and conversations of adult Finnish Sign Language (FinSL) signers of different ages. CA is defined here as a type of depiction in which a ... -
Between bodily action and conventionalized structure : The neural mechanisms of constructed action in sign language comprehension
Hernández, Doris; Puupponen, Anna; Keränen, Jarkko; Ortega, Gerardo; Jantunen, Tommi (Elsevier, 2024)Sign languages (SLs) are expressed through different bodily actions, ranging from re-enactment of physical events (constructed action, CA) to sequences of lexical signs with internal structure (plain telling, PT). Despite ... -
Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill
Torvinen, Petra; Ruotsalainen, Keijo S.; Zhao, Shuang; Cronin, Neil; Ohtonen, Olli; Linnamo, Vesa (MDPI AG, 2024)In this study, we developed a deep learning-based 3D markerless motion capture system for skate skiing on a treadmill and evaluated its accuracy against marker-based motion capture during G1 and G3 skating techniques. ... -
Opening up Corpus FinSL : enriching corpus analysis with linguistic ethnography in a study of constructed action
Puupponen, Anna; Hodge, Gabrielle; Anible, Benjamin; Salonen, Juhana; Wainio, Tuija; Keränen, Jarkko; Hernández, Doris; Jantunen, Tommi (Mouton De Gruyter, 2024)Corpus methods are now established within the field of signed language linguistics. Empirical investigations of signed language corpora have challenged many early assumptions about the nature of deaf community signed ...
Ellei toisin mainittu, julkisesti saatavilla olevia JYX-metatietoja (poislukien tiivistelmät) saa vapaasti uudelleenkäyttää CC0-lisenssillä.