Framework for SQL Error Message Design : A Data-Driven Approach
Taipalus, T., & Grahn, H. (2023). Framework for SQL Error Message Design : A Data-Driven Approach. ACM Transactions on Software Engineering and Methodology, 33(1), Article 9. https://doi.org/10.1145/3607180
Date
2023Discipline
KognitiotiedeComputing Education ResearchTutkintokoulutusCognitive ScienceComputing Education ResearchDegree EducationCopyright
© 2023 Copyright held by the owner/author(s).
Software developers use a significant amount of time reading and interpreting error messages. However, error messages have often been based on either anecdotal evidence or expert opinion, disregarding novices, who arguably are the ones who benefit the most from effective error messages. Furthermore, the usability aspects of Structured Query Language (SQL) error messages have not received much scientific attention. In this mixed-methods study, we coded a total of 128 error messages from eight database management systems (DBMS), and using data from 311 participants, analysed 4,796 queries using regression analysis to find out if and how acknowledged error message qualities explain SQL syntax error fixing success rates. Additionally, we performed a conventional content analysis on 1,505 suggestions on how to improve SQL error messages, and based on the analysis, formulated a framework consisting of nine guidelines for SQL error message design. The results indicate that general error message qualities do not necessarily explain query fixing success in the context of SQL syntax errors and that even some novel NewSQL systems fail to account for basic error message design guidelines. The error message design framework, and examples of its practical applications shown in this study, are applicable in educational contexts, as well as by DBMS vendors in understanding novice perspectives in error message design.
...
Publisher
Association for Computing Machinery (ACM)ISSN Search the Publication Forum
1049-331XKeywords
Publication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/183848188
Metadata
Show full item recordCollections
License
Related items
Showing items with similar title or keywords.
-
Interactionist Approach to Visual Aesthetics in HCI
Silvennoinen, Johanna (Springer International Publishing, 2021)Visual Aesthetics has gathered interest among scholars in HCI research. The growing interest stems from examinations of the aesthetic-usability effect (“what is beautiful is usable”), and possibly vice versa. Thus, numerous ... -
Reflections on the human role in AI policy formulations : how do national AI strategies view people?
Salo-Pöntinen, Henrikki; Saariluoma, Pertti (Springer Science and Business Media LLC, 2022)Purpose There is no artificial intelligence (AI) without people. People design and develop AI; they modify and use it and they have to reorganize the ways they have carried out tasks in their work and everyday life. ... -
Building Blocks Towards More Effective SQL Error Messages
Taipalus, Toni; Grahn, Hilkka (ACM, 2024)Reading and interpreting error messages are significant aspects of a software developer's work. Despite the importance and prevalence of error messages, especially for novices, SQL compiler error messages from various ... -
Interacting with intelligent agents : key issues in agent-based decision support system design
Liu, Shenghua (University of Jyväskylä, 2010) -
GUI personalization framework driven by personal semantic user profile
Suopellonmäki, Pekka (2017)Sovelluskehys käyttöliittymän personointiin käyttäen semanttista käyttäjäprofiilia. Internetin kehittyessä maailma verkostoituu yhä enemmän. Käytämme päivittäin monia laitteita ja erilaisia käyttöliittymiä, mutta vaikka ...