Evidence-based programming language design : a philosophical and methodological exploration
Published inJyväskylä studies in computing
Background: Programming language design is not usually informed by empirical studies. In other ﬁelds similar problems have inspired an evidence-based paradigm of practice. Such a paradigm is practically inevitable in language design, as well. Aims: The content of evidence-based programming design (EB-PLD) is explored, as is the concept of evidence in general. Additionally, the extent of evidence potentially useful for EB-PLD is mapped, and the appropriateness of Cohen’s kappa for evaluating coder agreement in a secondary study is evaluated. Method: Philosophical analysis and explication are used to clarify the unclear. A systematic mapping study was conducted to map out the existing body of evidence. Results: Evidence is a report of observations that affects the strength of an argument. There is some but not much evidence. EB-PLD is a ﬁve-step process for resolving uncertainty about design problems. Cohen’s kappa is inappropriate for coder agreement evaluation in systematic secondary studies. Conclusions: Coder agreement evaluation should use Scott’s pi, Fleiss’ kappa, or Krippendorff’s alpha. EB-PLD is worthy of further research, although its usefulness was out of scope here. ...
PublisherUniversity of Jyväskylä
programming languages programming language design evidence-based paradigm philosophical analysis evidence systematic mapping study coder agreement analysis Kirjallisuuskatsaukset Käsiteanalyysi ohjelmointi ohjelmointikielet suunnittelu kehittäminen empiirinen tutkimus näyttöön perustuvat käytännöt metodologia tutkimusmenetelmät
MetadataShow full item record
- Väitöskirjat 
Showing items with similar title or keywords.
The extent of empirical evidence that could inform evidence-based design of programming languages : a systematic mapping study Kaijanaho, Antti-Juhani (University of Jyväskylä, 2014)
Quantifying and addressing the prevalence and bias of study designs in the environmental and social sciences Christie, Alec P.; Abecasis, David; Adjeroud, Mehdi; Alonso, Juan C.; Amano, Tatsuya; Anton, Alvaro; Baldigo, Barry P.; Barrientos, Rafael; Bicknell, Jake E.; Buhl, Deborah A.; Cebrian, Just; Ceia, Ricardo S.; Cibils-Martina, Luciana; Clarke, Sarah; Claudet, Joachim; Craig, Michael D.; Davoult, Dominique; De Backer, Annelies; Donovan, Mary K.; Eddy, Tyler D.; França, Filipe M.; Gardner, Jonathan P. A.; Harris, Bradley P.; Huusko, Ari; Jones, Ian L.; Kelaher, Brendan P.; Kotiaho, Janne S.; López-Baucells, Adrià; Major, Heather L.; Mäki-Petäys, Aki; Martín, Beatriz; Martín, Carlos A.; Martin, Philip A.; Mateos-Molina, Daniel; McConnaughey, Robert A.; Meroni, Michele; Meyer, Christoph F. J.; Mills, Kade; Montefalcone, Monica; Noreika, Norbertas; Palacín, Carlos; Pande, Anjali; Pitcher, C. Roland; Ponce, Carlos; Rinella, Matt; Rocha, Ricardo; Ruiz-Delgado, María C.; Schmitter-Soto, Juan J.; Shaffer, Jill A.; Sharma, Shailesh; Sher, Anna A.; Stagnol, Doriane; Stanley, Thomas R.; Stokesbury, Kevin D. E.; Torres, Aurora; Tully, Oliver; Vehanen, Teppo; Watts, Corinne; Zhao, Qingyuan; Sutherland, William J. (Nature Publishing Group, 2020)Building trust in science and evidence-based decision-making depends heavily on the credibility of studies and their findings. Researchers employ many different study designs that vary in their risk of bias to evaluate the ...
Teaching master’s degree students to read research literature : Experience in a programming languages course 2002-2017 Kaijanaho, Antti-Juhani (ACM, 2017)The skill to read research literature critically belongs in every university graduate’s toolbox. I have attempted to teach this skill in a master’s degree level course in programming languages over 15 years using, at ...
Between context and comparability : Exploring new solutions for a familiar methodological challenge in qualitative comparative research Kosmützky, Anna; Nokkala, Terhi; Diogo, Sara (Wiley-Blackwell, 2020)Finding the balance between adequately describing the uniqueness of the context of studied phenomena and maintaining sufficient common ground for comparability and analytical generalisation has widely been recognised as a ...
Explaining the Difference between Policy-Based Evidence and Evidence-Based Policy : A Nexus Analysis Approach to Mobilities and Migration Aarnikoivu, Melina; Korhonen, Sirpa; Habti, Driss; Hoffman, David (Sam Houston State University, 2019)In this policy analysis, we explain the difference between policy-based evidence (PBE) and evidence-based policy (EBP). We argue that better, evidence-based understanding, explanations, and questions can be sought by ...