Do Randomized Algorithms Improve the Efficiency of Minimal Learning Machine?
Abstract
Minimal Learning Machine (MLM) is a recently popularized supervised learning method, which is composed of distance-regression and multilateration steps. The computational complexity of MLM is dominated by the solution of an ordinary least-squares problem. Several different solvers can be applied to the resulting linear problem. In this paper, a thorough comparison of possible and recently proposed, especially randomized, algorithms is carried out for this problem with a representative set of regression datasets. In addition, we compare MLM with shallow and deep feedforward neural network models and study the effects of the number of observations and the number of features with a special dataset. To our knowledge, this is the first time that both scalability and accuracy of such a distance-regression model are being compared to this extent. We expect our results to be useful on shedding light on the capabilities of MLM and in assessing what solution algorithms can improve the efficiency of MLM. We conclude that (i) randomized solvers are an attractive option when the computing time or resources are limited and (ii) MLM can be used as an out-of-the-box tool especially for high-dimensional problems.
Main Authors
Format
Articles
Research article
Published
2020
Series
Subjects
Publication in research information system
Publisher
MDPI AG
The permanent address of the publication
https://urn.fi/URN:NBN:fi:jyu-202011186669Käytä tätä linkitykseen.
Review status
Peer reviewed
ISSN
2504-4990
DOI
https://doi.org/10.3390/make2040029
Language
English
Published in
Machine Learning and Knowledge Extraction
Citation
- Linja, J., Hämäläinen, J., Nieminen, P., & Kärkkäinen, T. (2020). Do Randomized Algorithms Improve the Efficiency of Minimal Learning Machine?. Machine Learning and Knowledge Extraction, 2(4), 533-557. https://doi.org/10.3390/make2040029
Funder(s)
Research Council of Finland
Research Council of Finland
Funding program(s)
Academy Programme, AoF
Research profiles, AoF
Akatemiaohjelma, SA
Profilointi, SA
![Research Council of Finland Research Council of Finland](/jyx/themes/jyx/images/funders/sa_logo.jpg?_=1739278984)
Additional information about funding
This work was supported by the Academy of Finland from the projects 311877 (Demo) and 315550 (HNP-AI).
Copyright© 2020 by the authors. Licensee MDPI, Basel, Switzerland.