A Workflow for Building Computationally Rational Models of Human Behavior
Chandramouli, S., Shi, D., Putkonen, A., De Peuter, S., Zhang, S., Jokinen, J., Howes, A., & Oulasvirta, A. (2024). A Workflow for Building Computationally Rational Models of Human Behavior. Computational Brain & Behavior, Early online. https://doi.org/10.1007/s42113-024-00208-6
Published in
Computational Brain & BehaviorAuthors
Date
2024Copyright
© The Author(s) 2024
Computational rationality explains human behavior as arising due to the maximization of expected utility under the constraints imposed by the environment and limited cognitive resources. This simple assumption, when instantiated via partially observable Markov decision processes (POMDPs), gives rise to a powerful approach for modeling human adaptive behavior, within which a variety of internal models of cognition can be embedded. In particular, such an instantiation enables the use of methods from reinforcement learning (RL) to approximate the optimal policy solution to the sequential decision-making problems posed to the cognitive system in any given setting; this stands in contrast to requiring ad hoc hand-crafted rules for capturing adaptive behavior in more traditional cognitive architectures. However, despite their successes and promise for modeling human adaptive behavior across everyday tasks, computationally rational models that use RL are not easy to build. Being a hybrid of theoretical cognitive models and machine learning (ML) necessitates that model building take into account appropriate practices from both cognitive science and ML. The design of psychological assumptions and machine learning decisions concerning reward specification, policy optimization, parameter inference, and model selection are all tangled processes rife with pitfalls that can hinder the development of valid and effective models. Drawing from a decade of work on this approach, a workflow is outlined for tackling this challenge and is accompanied by a detailed discussion of the pros and cons at key decision points.
...
Publisher
Springer NatureISSN Search the Publication Forum
2522-0861Keywords
Publication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/233428528
Metadata
Show full item recordCollections
Additional information about funding
Open Access funding provided by Aalto University. This work was supported by the Research Council of Finland (flagship program: Finnish Center for Artificial Intelligence, FCAI, grants 328400, 345604, 341763; Human Automata, grant 328813; Subjective Functions, grant 357578). Machines that Understand People, grant 330347. S.C was also supported by the Jorma Ollila Grant from Nokia Foundation.License
Related items
Showing items with similar title or keywords.
-
Modeling human road crossing decisions as reward maximization with visual perception limitations
Wang, Yueyang; Srinivasan, Aravinda Ramakrishnan; Jokinen, Jussi, P. P.; Oulasvirta, Antti; Markkula, Gustav (IEEE, 2023)Understanding the interaction between different road users is critical for road safety and automated vehicles (AVs). Existing mathematical models on this topic have been proposed based mostly on either cognitive or machine ... -
Multitasking in Driving as Optimal Adaptation Under Uncertainty
Jokinen, Jussi P. P.; Kujala, Tuomo; Oulasvirta, Antti (SAGE Publications, 2021)Objective. The objective was to better understand how people adapt multitasking behavior when circumstances in driving change and how safe versus unsafe behaviors emerge. Background. Multitasking strategies in driving ... -
A dynamic adjustment model of saccade lengths in reading for word-spaced orthographies : evidence from simulations and invisible boundary experiments
Hautala, Jarkko; Hawelka, Stefan; Loberg, Otto; Leppänen, Paavo H.T. (Taylor & Francis, 2022)Contemporary models of eye movement control in reading assume a discrete target word selection process preceding saccade length computation, while the selection itself is assumed to be driven by word identification processes. ... -
Simulating Emotions With an Integrated Computational Model of Appraisal and Reinforcement Learning
Zhang, Jiayi Eurus; Hilpert, Bernhard; Broekens, Joost; Jokinen, Jussi P. P. (ACM, 2024)Predicting users’ emotional states during interaction is a long-standing goal of affective computing. However, traditional methods based on sensory data alone fall short due to the interplay between users’ latent cognitive ... -
Computational Rationality as a Theory of Interaction
Oulasvirta, Antti; Jokinen, Jussi P. P.; Howes, Andrew (ACM, 2022)How do people interact with computers? This fundamental question was asked by Card, Moran, and Newell in 1983 with a proposition to frame it as a question about human cognition – in other words, as a matter of how information ...