Continuous Software Engineering Practices in AI/ML Development Past the Narrow Lens of MLOps : Adoption Challenges
Vänskä, S., Kemell, K.-K., Mikkonen, T., & Abrahamsson, P. (2024). Continuous Software Engineering Practices in AI/ML Development Past the Narrow Lens of MLOps : Adoption Challenges. E-Informatica, 18(1), 240102. https://doi.org/10.37190/e-Inf240102
Julkaistu sarjassa
E-InformaticaPäivämäärä
2024Tekijänoikeudet
© 2024 The Authors. Published by Wrocław University of Science and Technology Publishing House.
Background: Continuous software engineering practices are currently considered state of the art in Software Engineering (SE). Recently, this interest in continuous SE has extended to ML system development as well, primarily through MLOps. However, little is known about continuous SE in ML development outside the specific continuous practices present in MLOps.
Aim: In this paper, we explored continuous SE in ML development more generally, outside the specific scope of MLOps. We sought to understand what challenges organizations face in adopting all the 13 continuous SE practices identified in existing literature.
Method: We conducted a multiple case study of organizations developing ML systems. Data from the cases was collected through thematic interviews. The interview instrument focused on different aspects of continuous SE, as well as the use of relevant tools and methods.
Results: We interviewed 8 ML experts from different organizations. Based on the data, we identified various challenges associated with the adoption of continuous SE practices in ML development. Our results are summarized through 7 key findings.
Conclusion: The largest challenges we identified seem to stem from communication issues. ML experts seem to continue to work in silos, detached from both the rest of the project and the customers.
...
![showless](/themes/JYX2//images/showless.png)
![showmore](/themes/JYX2//images/showmore.png)
Julkaisija
Politechnika Wroclawska Oficyna WydawniczaISSN Hae Julkaisufoorumista
1897-7979Asiasanat
Julkaisu tutkimustietojärjestelmässä
https://converis.jyu.fi/converis/portal/detail/Publication/194848990
Metadata
Näytä kaikki kuvailutiedotKokoelmat
Lisenssi
Samankaltainen aineisto
Näytetään aineistoja, joilla on samankaltainen nimeke tai asiasanat.
-
Practices and Infrastructures for Machine Learning Systems : An Interview Study in Finnish Organizations
Muiruri, Dennis; Lwakatare, Lucy Ellen; Nurminen, Jukka K.; Mikkonen, Tommi (Institute of Electrical and Electronics Engineers (IEEE), 2022)Using interviews, we investigated the practices and toolchains for machine learning (ML)-enabled systems from 16 organizations across various domains in Finland. We observed some well-established artificial intelligence ... -
Utilizing User Stories to Bring AI Ethics into Practice in Software Engineering
Kemell, Kai-Kristian; Vakkuri, Ville; Halme, Erika (Springer International Publishing, 2022)AI ethics is a research area characterized by a prominent gap between research and practice. With most studies in the area being conceptual in nature or focused on technical ML (Machine Learning) solutions, the link between ... -
Strategic cyber threat intelligence : Building the situational picture with emerging technologies
Voutilainen, Janne; Kari, Martti (Academic Conferences International, 2020)In 2019, e-criminals adopted new tactics to demand enormous ransoms from large organizations by using ransomware, a phenomenon known as “big game hunting.” Big game hunting is an excellent example of a sophisticated and ... -
Continuous experimentation on artificial intelligence software : a research agenda
Nguyen-Duc, Anh; Abrahamsson, Pekka (ACM, 2020)Moving from experiments to industrial level AI software development requires a shift from understanding AI/ ML model attributes as a standalone experiment to know-how integrating and operating AI models in a large-scale ... -
On Attacking Future 5G Networks with Adversarial Examples : Survey
Zolotukhin, Mikhail; Zhang, Di; Hämäläinen, Timo; Miraghaei, Parsa (MDPI AG, 2023)The introduction of 5G technology along with the exponential growth in connected devices is expected to cause a challenge for the efficient and reliable network resource allocation. Network providers are now required to ...
Ellei toisin mainittu, julkisesti saatavilla olevia JYX-metatietoja (poislukien tiivistelmät) saa vapaasti uudelleenkäyttää CC0-lisenssillä.