Taxonomy-Informed Neural Networks for Smart Manufacturing
Terziyan, V., & Vitko, O. (2024). Taxonomy-Informed Neural Networks for Smart Manufacturing. Procedia Computer Science, 232, 1388-1399. https://doi.org/10.1016/j.procs.2024.01.137
Published in
Procedia Computer ScienceDate
2024Copyright
© 2024 The Authors. Published by Elsevier B.V.
A neural network (NN) is known to be an efficient and learnable tool supporting decision-making processes particularly in Industry 4.0. The majority of NNs are data-driven and, therefore, depend on training data quantity and quality. The current trend in enhancing data-driven models with knowledge-based models promises to enable effective NNs with less data. So-called physics-informed NNs use additional knowledge from computational science to improve NN training. Quite much of the knowledge is available as logical constraints from domain ontologies, and NNs may benefit from using it. In this paper, we study the concept of Taxonomy-Informed NN (TINN), which combines data-driven training of NNs with ontological knowledge. We study different patterns of NN training with additional knowledge on class-subclass hierarchies and instance-class relationships with potential for federated learning. Our experiments show that additional knowledge, which influences TINNs’ training process through the loss function at backpropagation, improves the quality of trained models.
See presentation slides: https://ai.it.jyu.fi/ISM-2023-TINN.pptx
...
Publisher
ElsevierISSN Search the Publication Forum
1877-0509Keywords
Publication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/207725426
Metadata
Show full item recordCollections
License
Related items
Showing items with similar title or keywords.
-
Assessment of microalgae species, biomass, and distribution from spectral images using a convolution neural network
Salmi, Pauliina; Calderini, Marco; Pääkkönen, Salli; Taipale, Sami; Pölönen, Ilkka (Springer Science and Business Media LLC, 2022)Effective monitoring of microalgae growth is crucial for environmental observation, while the applications of this monitoring could also be expanded to commercial and research-focused microalgae cultivation. Currently, the ... -
Node co-activations as a means of error detection : Towards fault-tolerant neural networks
Myllyaho, Lalli; Nurminen, Jukka K.; Mikkonen, Tommi (Elsevier, 2022)Context: Machine learning has proved an efficient tool, but the systems need tools to mitigate risks during runtime. One approach is fault tolerance: detecting and handling errors before they cause harm. Objective: This ... -
Quantification of Errors Generated by Uncertain Data in a Linear Boundary Value Problem Using Neural Networks
Halonen, Vilho; Pölönen, Ilkka (Society for Industrial & Applied Mathematics (SIAM), 2023)Quantifying errors caused by indeterminacy in data is currently computationally expensive even in relatively simple PDE problems. Efficient methods could prove very useful in, for example, scientific experiments done with ... -
Process‐Informed Neural Networks : A Hybrid Modelling Approach to Improve Predictive Performance and Inference of Neural Networks in Ecology and Beyond
Wesselkamp, Marieke; Moser, Niklas; Kalweit, Maria; Boedecker, Joschka; Dormann, Carsten F. (Wiley, 2024)Despite deep learning being state of the art for data-driven model predictions, its application in ecology is currently subject to two important constraints: (i) deep-learning methods are powerful in data-rich regimes, but ... -
Deep Neural Networks, Cellular Automata and Petri Nets : Useful Hybrids for Smart Manufacturing
Kaikova, Olena; Terziyan, Vagan (Elsevier, 2024)In the era of Industry 4.0 and beyond, intelligent and reliable models are vital for processes and assets. Models in smart manufacturing involve combining knowledge-based and data-driven methods with discrete and continuous ...