Modelling multivariate spatio-temporal data with identifiable variational autoencoders

Abstract
Modelling multivariate spatio-temporal data with complex dependency structures is a challenging task but can be simplified by assuming that the original variables are generated from independent latent components. If these components are found, they can be modelled univariately. Blind source separation aims to recover the latent components by estimating the unknown linear or nonlinear unmixing transformation based on the observed data only. In this paper, we extend recently introduced identifiable variational autoencoder to the nonlinear nonstationary spatio-temporal blind source separation setting and demonstrate its performance using comprehensive simulation studies. Additionally, we introduce two alternative methods for the latent dimension estimation, which is a crucial task in order to obtain the correct latent representation. Finally, we illustrate the proposed methods using a meteorological application, where we estimate the latent dimension and the latent components, interpret the components, and show how nonstationarity can be accounted and prediction accuracy can be improved by using the proposed nonlinear blind source separation method as a preprocessing method.
Main Authors
Format
Articles Research article
Published
2025
Series
Subjects
Publication in research information system
Publisher
Elsevier
The permanent address of the publication
https://urn.fi/URN:NBN:fi:jyu-202410236478Use this for linking
Review status
Peer reviewed
ISSN
0893-6080
DOI
https://doi.org/10.1016/j.neunet.2024.106774
Language
English
Published in
Neural Networks
Citation
  • Sipilä, M., Cappello, C., De Iaco, S., Nordhausen, K., & Taskinen, S. (2025). Modelling multivariate spatio-temporal data with identifiable variational autoencoders. Neural Networks, 181, Article 106774. https://doi.org/10.1016/j.neunet.2024.106774
License
CC BY 4.0Open Access
Additional information about funding
We acknowledge the support from Vilho, Yrjö and Kalle Väisälä foundation for MS, the support from the Research Council of Finland (453691) to ST, the support from the Research Council of Finland (363261) to KN and the support from the HiTEc COST Action (CA21163) to KN and ST.
Copyright© 2024 The Authors. Published by Elsevier Ltd.

Share