An Evaluation of Research Methods Used in Computer Science Education Studies

Abstract

Methodological evaluations have been effective in uncovering patterns in research and enhancing research procedures in various academic fields. Three methodological reviews have been conducted on the developing subject of computer science education research. However, these evaluations were shown to have deficiencies in terms of their dependability and generalizability. This article provides a thorough, trustworthy, and practical summary of the most recent studies on computer science teaching. This evaluation is important because it provides an opportunity to enhance computer science education practice and tackles the limitations of past methodological reviews. The main focus of our research was to examine the methodological aspects of studies published in reputable computer science education research forums between 2000 and 2005. This investigation included nine specific subquestions. The main purpose of this methodological review is to promote informed discussion about the implementation of computer science education and to establish a strong methodological foundation for recommendations that will further research in computer science education. A sample of 352 articles was randomly selected from a total of 1306 computer science education papers published between 2000 and 2005. The sample was chosen in a way that ensures it is representative of the entire population. Coding was conducted on many aspects of the 352 articles, including their general features, report components, study methodologies, research design, independent and dependent variables, as well as mediating/moderating variables analyzed. Statistical processes were also examined. A second assessor coded a total of 53 items for the reliability subsample. When analyzing the results of the study, suggestions are made to enhance the existing body of research on computer science education.

Keywords- Research Methods, Computer Science Education Studies