Apperception as a Multisensory Process in Material Experience
Silvennoinen, J., Rousi, R., Jokinen, J., & Perälä, P. (2015). Apperception as a Multisensory Process in Material Experience. In Academic MindTrek'15 : Proceedings of the 19th International Academic MindTrek Conference (pp. 144-151). Association for Computing Machinery (ACM). doi:10.1145/2818187.2818285
© 2015 ACM. This is a final draft version of an article whose final and definitive form has been published by ACM. Published in this repository with the kind permission of the publisher.
Visual perspective has dominated experience research in humantechnology interaction for decades now. The neglect of other sensory modalities is gradually being addressed by scholars and designers, who investigate user experience based on touch, smell, taste, sound and even expressive bodily interactions. In cognitive and affective processes, user experience is always multi-modal, not just regarding perceived multi-sensory information, but also while perceiving through one modality we mentally construct information relevant to the other senses. This article reports the results of an experiment, where participants (N = 52) appraised materials either only by touching them or only by seeing. The results indicate that with certain affects, the logic of the appraisal depends on the modality. These results are discussed within the theoretical framework of mental content, apperception, and appraisal. Further, we discuss the relevance of the findings for material design, especially in the context of multimodal interaction. ...