co

Learning Circles: A Collaborative Technology-Mediated Peer-Teaching Workshop

This research study explores peer teaching and learning without a domain expert teacher, within the context of an activity where teams of second level students (~16 years old) are required to create a learning experience for their peers. The study looks at how participants would like to be taught and how they would teach their peers if given the opportunity and examines the support they require, their motivation levels, and if they actually learn curriculum content using this approach. An exploratory case study methodology was used, and the findings suggest that students want varied learning experiences that include many of the elements which would fall under the heading of 21st century learning, that with some support and encouragement they can create innovative learning experiences for their peers, and that they can learn curriculum content from the process.




co

Effectiveness of Peer Assessment in a Professionalism Course Using an Online Workshop

An online Moodle Workshop was evaluated for peer assessment effectiveness. A quasi-experiment was designed using a Seminar in Professionalism course taught in face-to-face mode to undergraduate students across two campuses. The first goal was to determine if Moodle Workshop awarded a fair peer grader grade. The second objective was to estimate if students were consistent and reliable in performing their peer assessments. Statistical techniques were used to answer the research hypotheses. Although Workshop Moodle did not have a built-in measure for peer assessment validity, t-tests and reliability estimates were calculated to demonstrate that the grades were consistent with what faculty expected. Implications were asserted to improve teaching and recommendations were provided to enhance Moodle.




co

Beyond Coursework: Developing Communities in an Online Program of Study

The nexus between paid work and study is important. Developing opportunities to facilitate this link is a key part of good course design especially in postgraduate programs. Strong communities of practice can also assist with improving links between research and practice. The online study environment affords some challenges to achieving these goals. The current study proposes that offering formalised interaction points— synchronous or asynchronous— during online study, is critical to facilitating the link between work and study. Twenty-five graduates of a postgraduate program were interviewed to explore their experiences of an online program of study. Three key themes emerged and are described in this paper: engaging with study, building a new framework for my practice, and implementing changes to my practice. Online learning programs need to embed opportunities for interaction that are meaningful and allow for development of ideas and discussion, aiming to take learning beyond the program of study.




co

“Hour of Code”: Can It Change Students’ Attitudes toward Programming?

The Hour of Code is a one-hour introduction to computer science organized by Code.org, a non-profit dedicated to expanding participation in computer science. This study investigated the impact of the Hour of Code on students’ attitudes towards computer programming and their knowledge of programming. A sample of undergraduate students from two universities was selected to participate. Participants completed an Hour of Code tutorial as part of an undergraduate course. An electronic questionnaire was implemented in a pre-survey and post-survey format to gauge the change in student attitudes toward programming and their programming ability. The findings indicated the positive impact of the Hour of Code tutorial on students’ attitude toward programming. However, the students’ programming skills did not significantly change. The authors suggest that a deeper alignment of marketing, teaching, and content would help sustain the type of initiative exemplified by the Hour of Code.




co

A Comparison of Student Academic Performance with Traditional, Online, And Flipped Instructional Approaches in a C# Programming Course

Aim/Purpose: Compared student academic performance on specific course requirements in a C# programming course across three instructional approaches: traditional, online, and flipped. Background: Addressed the following research question: When compared to the online and traditional instructional approaches, does the flipped instructional approach have a greater impact on student academic performance with specific course requirements in a C# programming course? Methodology: Quantitative research design conducted over eight 16-week semesters among a total of 271 participants who were undergraduate students en-rolled in a C# programming course. Data collected were grades earned from specific course requirements and were analyzed with the nonparametric Kruskal Wallis H-Test using IBM SPSS Statistics, Version 23. Contribution: Provides empirical findings related to the impact that different instructional approaches have on student academic performance in a C# programming course. Also describes implications and recommendations for instructors of programming courses regarding instructional approaches that facilitate active learning, student engagement, and self-regulation. Findings: Resulted in four statistically significant findings, indicating that the online and flipped instructional approaches had a greater impact on student academic performance than the traditional approach. Recommendations for Practitioners: Implement instructional approaches such as online, flipped, or blended which foster active learning, student engagement, and self-regulation to increase student academic performance. Recommendation for Researchers: Build upon this study and others similar to it to include factors such as gender, age, ethnicity, and previous academic history. Impact on Society: Acknowledge the growing influence of technology on society as a whole. Higher education coursework and programs are evolving to encompass more digitally-based learning contexts, thus compelling faculty to utilize instructional approaches beyond the traditional, lecture-based approach. Future Research: Increase the number of participants in the flipped instructional approach to see if it has a greater impact on student academic performance. Include factors beyond student academic performance to include gender, age, ethnicity, and previous academic history.




co

The Impact of User Interface on Young Children’s Computational Thinking

Aim/Purpose: Over the past few years, new approaches to introducing young children to computational thinking have grown in popularity. This paper examines the role that user interfaces have on children’s mastery of computational thinking concepts and positive interpersonal behaviors. Background: There is a growing pressure to begin teaching computational thinking at a young age. This study explores the affordances of two very different programming interfaces for teaching computational thinking: a graphical coding application on the iPad (ScratchJr) and tangible programmable robotics kit (KIBO). Methodology : This study used a mixed-method approach to explore the learning experiences that young children have with tangible and graphical coding interfaces. A sample of children ages four to seven (N = 28) participated. Findings: Results suggest that type of user interface does have an impact on children’s learning, but is only one of many factors that affect positive academic and socio-emotional experiences. Tangible and graphical interfaces each have qualities that foster different types of learning




co

Secure E-Examination Systems Compared: Case Studies from Two Countries

Aim/Purpose: Electronic examinations have some inherent problems. Students have expressed negative opinions about electronic examinations (e-examinations) due to a fear of, or unfamiliarity with, the technology of assessment, and a lack of knowledge about the methods of e-examinations. Background: Electronic examinations are now a viable alternative method of assessing student learning. They provide freedom of choice, in terms of the location of the examination, and can provide immediate feedback; students and institutions can be assured of the integrity of knowledge testing. This in turn motivates students to strive for deeper learning and better results, in a higher quality and more rigorous educational process. Methodology : This paper compares an e-examination system at FUT Minna Nigeria with one in Australia, at the University of Tasmania, using case study analysis. The functions supported, or inhibited, by each of the two e-examination systems, with different approaches to question types, cohort size, technology used, and security features, are compared. Contribution: The researchers’ aim is to assist stakeholders (including lecturers, invigilators, candidates, computer instructors, and server operators) to identify ways of improving the process. The relative convenience for students, administrators, and lecturer/assessors and the reliability and security of the two systems are considered. Challenges in conducting e-examinations in both countries are revealed by juxtaposing the systems. The authors propose ways of developing more effective e-examination systems. Findings: The comparison of the two institutions in Nigeria and Australia shows e-examinations have been implemented for the purpose of selecting students for university courses, and for their assessment once enrolled. In Nigeria, there is widespread systemic adoption for university entrance merit selection. In Australia this has been limited to one subject in one state, rather than being adopted nationally. Within undergraduate courses, the Nigerian scenario is quite extensive; in Australia this adoption has been slower, but has penetrated a wide variety of disciplines. Recommendations for Practitioners: Assessment integrity and equipment reliability were common issues across the two case studies, although the delivery of e-examinations is different in each country. As with any procedural process, a particular solution is only as good as its weakest attribute. Technical differences highlight the link between e-examination system approaches and pedagogical implications. It is clear that social, cultural, and environmental factors affect the success of e-examinations. For example, an interrupted electrical power supply and limited technical know-how are two of the challenges affecting the conduct of e-examinations in Nigeria. In Tasmania, the challenge with the “bring your own device” (BYOD) is to make the system operate on an increasing variety of user equipment, including tablets. Recommendation for Researchers: The comparisons between the two universities indicate there will be a productive convergence of the approaches in future. One key proposal, which arose from the analysis of the existing e-examination systems in Nigeria and Australia, is to design a form of “live” operating system that is deployable over the Internet. This method would use public key cryptography for lecturers to encrypt their questions online. Impact on Society : If institutions are to transition to e-examinations, one way of facilitating this move is by using computers to imitate other assessment techniques. However, higher order thinking is usually demonstrated through open-ended or creative tasks. In this respect the Australian system shows promise by providing the same full operating system and software application suite to all candidates, thereby supporting assessment of such creative higher order thinking. The two cases illustrate the potential tension between “online” or networked reticulation of questions and answers, as opposed to “offline” methods. Future Research: A future design proposition is a web-based strategy for a virtual machine, which is launched into candidates’ computers at the start of each e-examination. The new system is a form of BYOD externally booted e-examination (as in Australia) that is deployable over the Internet with encryption and decryption features using public key cryptography (Nigeria). This will allow lecturers to encrypt their questions and post them online while the questions are decrypted by the administrator or students are given the key. The system will support both objective and open-ended questions (possibly essays and creative design tasks). The authors believe this can re-define e-examinations as the “gold standard” of assessment.




co

The Impact of Hands-On Simulation Laboratories on Teaching of Wireless Communications

Aim/Purpose: To prepare students with both theoretical knowledge and practical skills in the field of wireless communications. Background: Teaching wireless communications and networking is not an easy task because it involves broad subjects and abstract content. Methodology: A pedagogical method that combined lectures, labs, assignments, exams, and readings was applied in a course of wireless communications. Contribution: Five wireless networking labs, related to wireless local networks, wireless security, and wireless sensor networks, were developed for students to complete all of the required hands-on lab activities. Findings: Both development and implementation of the labs achieved a successful outcome and provided students with a very effective learning experience. Students expressed that they had a better understanding of different wireless network technologies after finishing the labs. Recommendations for Practitioners: Detailed instructional lab manuals should be developed so that students can carry out hands-on activities in a step-by-step fashion. Recommendation for Researchers: Hands-on lab exercises can not only help students understand the abstract technical terms in a meaningful way, but also provide them with hands-on learning experience in terms of wireless network configuration, implementation, and evaluation. Impact on Society: With the help of a wireless network simulator, students have successfully enhanced their practical skills and it would benefit them should they decide to pursue a career in wireless network design or implementation. Future Research: Continuous revision of the labs will be made according to the feedback from students. Based on the experience, more wireless networking labs and network issues could be studied in the future.




co

Learning by Doing: Twenty Successful Active Learning Exercises for Information Systems Courses

Aim/Purpose: This paper provides a review of previously published work related to active learning in information systems (IS) courses. Background: There are a rising number of strategies in higher education that offer promise in regards to getting students’ attention and helping them learn, such as flipped classrooms and offering courses online. These learning strategies are part of the pedagogical technique known as active learning. Active learning is a strategy that became popular in the early 1990s and has proven itself as a valid tool for helping students to be engaged with learning. Methodology: This work follows a systematic method for identifying and coding previous research based on an aspect of interest. The authors identified and assessed research through a search of ABI/Inform scholarly journal abstracts and keywords, as well as additional research databases, using the search terms “active learning” and “information systems” from 2000 through June 2016. Contribution: This synthesis of active learning exercises provides guidance for information technology faculty looking to implement active learning strategies in their classroom by demonstrating how IS faculty might begin to introduce more active learning techniques in their teaching as well as by presenting a sample teaching agenda for a class that uses a mix of active and passive learning techniques to engage student learning. Findings: Twenty successful types of active learning exercises in IS courses are presented. Recommendations for Practitioners : This paper offers a “how to” resource of successful active learning strategies for IS faculty interested in implementing active learning in the classroom. Recommendation for Researchers: This work provides an example of a systematic literature review as a means to assess successful implementations of active learning in IS. Impact on Society: An updated definition of active learning is presented as well as a meaningful list of exercises that encourage active learning both inside and outside of the IS classroom. Future Research: In relation to future research, this study highlights a number of opportunities for IS faculty in regards to new active learning activities or trends to study further.




co

An Investigation of the Use of the ‘Flipped Classroom’ Pedagogy in Secondary English Language Classrooms

Aim/Purpose : To examine the use of a flipped classroom in the English Language subject in secondary classrooms in Hong Kong. Background: The research questions addressed were: (1) What are teachers’ perceptions towards the flipped classroom pedagogy? (2) How can teachers transfer their flipped classroom experiences to teaching other classes/subjects? (3) What are students’ perceptions towards the flipped classroom pedagogy? (4) How can students transfer their flipped classroom experiences to studying other subjects? (5) Will students have significant gain in the knowledge of the lesson topic trialled in this study? Methodology: A total of 57 students from two Secondary 2 classes in a Band 3 secondary school together with two teachers teaching these two classes were involved in this study. Both quantitative and quantitative data analyses were conducted. Contribution: Regarding whether the flipped classroom pedagogy can help students gain significantly in their knowledge of a lesson topic, only one class of students gained statistically significantly in the subject knowledge but not for another class. Findings: Students in general were positive about the flipped classroom. On the other hand, although the teachers considered that the flipped classroom pedagogy was creative, they thought it may only be useful for teaching English grammar. Recommendations for Practitioners: Teachers thought that flipping a classroom may only be useful for more motivated students, and the extra workload of finding or making suitable pre-lesson online videos is the main concern for teachers. Recommendations for Researchers: Both quantitative and qualitative analyses should be conducted to investigate the effectiveness of a flipped classroom on students’ language learning. Impact on Society : Teachers and students can transfer their flipped classroom experiences in English Language to teaching and studying other subjects. Future Research: More classes should be involved and a longer period of time should be spent on trial teaching in which a flipped classroom can be implemented in different lesson topics, not only teaching grammar. Teachers also need to determine if students can use the target language item in a task.




co

Activity Oriented Teaching Strategy for Software Engineering Course: An Experience Report

Aim/Purpose: This paper presents the findings of an Activity-Oriented Teaching Strategy (AOTS) conducted for a postgraduate level Software Engineering (SE) course with the aim of imparting meaningful software development experience for the students. The research question is framed as whether the activity-oriented teaching strategy helps students to acquire practical knowledge of Software Engineering and thus bridge the gap between academia and software industry. Background: Software Engineering Education (SEE) in India is mainly focused on teaching theoretical concepts rather than emphasizing on practical knowledge in software development process. It has been noticed that many students of CS/IT background are struggling when they start their career in the software industry due to inadequate familiarity with the software development process. In the current context of SE education, there is a knowledge gap between the theory learned in the classroom and the actual requirement demanded by the software industry. Methodology: The methodology opted for in this study was action research since the teachers are trying to solve the practical problems and deficiencies encountered while teaching SE. There are four pedagogies in AOTS for fulfilling the requirements of the desired teaching strategy. They are flipped classroom, project role-play for developing project artifacts, teaching by example, and student seminars. The study was conducted among a set of Postgraduate students of the Software Engineering programme at Cochin University of Science and Technology, India. Contribution: AOTS can fulfil both academic and industrial requirements by actively engaging the students in the learning process and thus helping them develop their professional skills. Findings: AOTS can be molded as a promising teaching strategy for learning Software Engineering. It focuses on the essential skill sets demanded by the software industry such as communication, problem-solving, teamwork, and understanding of the software development processes. Impact on Society: Activity-oriented teaching strategies can fulfil both academic and industrial requirements by actively engaging the students in the SE learning process and thus helping them in developing their professional skills. Future Research: AOTS can be refined by adding/modifying pedagogies and including different features like an online evaluation system, virtual classroom etc.




co

Collaborative Approach in Software Engineering Education: An Interdisciplinary Case

Aim/Purpose: This study was aimed at enhancing students’ learning of software engineering methods. A collaboration between the Computer Science, Business Management, and Product Design programs was formed to work on actual projects with real clients. This interdisciplinary form of collaboration simulates the realities of a diverse Software Engineering team. Background: A collaborative approach implemented through projects has been the established pedagogy for introducing the Software Engineering course to undergraduate Computer Science students. The collaboration, however, is limited to collaboration among Computer Science students and their clients. This case study explored an enhancement to the collaborative approach to project development by integrating other related disciplines into the project development framework; hence, the Interdisciplinary Approach. Methodology: This study adopted the case method approach. An interdisciplinary service innovation activity was proposed to invite other disciplines in the learning process of the computer science students. The agile methodology Scrum was used as the software development approach during project development. Survey data were collected from the students to establish (a) their perception of the interdisciplinary approach to project development; (b) the factors that influenced success or failure of their team to deliver the project; and (c) the perceived skills or knowledge that they acquired from the interdisciplinary approach. Analysis of data followed a mixed method approach. Contribution: The study improved the current pedagogy for Software Engineering education by integrating other related disciplines into the software project development framework. Findings: Data collected showed that the students generally accepted the interdisciplinary approach to project development. Factors such as project relevance, teamwork, time and schedule, and administration support, among others, affect team performance towards project completion. In the case of the Computer Science students, results show that students have learned skills during the experience that, as literature reveal, can only be acquired or mastered in their future profession as software engineers. Recommendations for Practitioners: The active collaboration of the industry with the University and the involvement of the other related courses in teaching software engineering methods are critical to the development of the students, not only in learning the methodology but also as a working professional. Recommendation for Researchers: It is interesting to know and eventually understand the interactions between interdisciplinary team members in the conduct of Software Engineering practices while working on their projects. More specifically, what creative tensions arise and how do the interdisciplinary teams handle the discourse? Impact on Society: This study bridges the gap between how Software Engineering is taught in the university and how Software Engineering teams work in real life. Future Research: Future research is targeted at refining and elaborating the elements of the interdisciplinary framework presented in this paper towards an integrated course module for Software Engineering education.




co

Introductory Information Systems Course Redesign: Better Preparing Business Students

Aim/Purpose: The dynamic nature of the information systems (IS) field presents educators with the perpetual challenge of keeping course offerings current and relevant. This paper describes the process at a College of Business (COB) to redesign the introductory IS course to better prepare students for advanced business classes and equip them with interdisciplinary knowledge and skills demanded in today’s workplace. Background: The course was previously in the Computer Science (CSC) Department, itself within the COB. However, an administrative restructuring resulted in the CSC department’s removal from the COB and left the core course in limbo. Methodology: This paper presents a case study using focus groups with students, faculty, and advisory council members to assess the value of the traditional introductory course. A survey was distributed to students after implementation of the newly developed course to assess the reception of the course. Contribution: This paper provides an outline of the decision-making process leading to the course redesign of the introductory IS course, including the context and the process of a new course development. Practical suggestions for implementing and teaching an introductory IS course in a business school are given. Findings: Focus group assessment revealed that stakeholders rated the existing introductory IS course of minimal value as students progressed through the COB program, and even less upon entering the workforce. The findings indicated a complete overhaul of the course was required. Recommendations for Practitioners: The subject of technology sometimes requires more than a simple update to the curriculum. When signs point to the need for a complete overhaul, this paper gives practical guidance supplemented with relevant literature for other academicians to follow. Recommendation for Researchers: Students are faced with increasing pressure to be proficient with the latest technology, in both the classroom where educators are trying to prepare them for the modern workplace, as well as the organization which faces an even greater pressure to leverage the latest technology. The newly designed introductory IS course provides students, and eventually organizations, a better measure of this proficiency. Future Research: Future research on the efficacy of this new course design should include longitudinal data to determine the impact on graduates, and eventually the assessment of those graduates’ performance in the workplace.




co

A Real-time Plagiarism Detection Tool for Computer-based Assessments

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of policy driven and plagiarism detection approaches. These mechanisms are either proactive or reactive and focus on identifying, catching, and punishing those found to have cheated or plagiarized. To be more effective against plagiarism, mechanisms that detect cheating or colluding in real-time are desirable. Methodology: In the development of a tool for real-time plagiarism prevention, literature review and prototyping was used. The prototype was implemented in Delphi programming language using Indy components. Contribution: A real-time plagiarism detection tool suitable for use in a computer-based assessment setting is developed. This tool can be used to complement other existing mechanisms. Findings: The developed tool was tested in an environment with 55 personal computers and found to be effective in detecting unauthorized access to internet, intranet, and USB ports on the personal computers. Recommendations for Practitioners: The developed tool is suitable for use in any environment where computer-based evaluation may be conducted. Recommendation for Researchers: This work provides a set of criteria for developing a real-time plagiarism prevention tool for use in a computer-based assessment. Impact on Society: The developed tool prevents academic dishonesty during an assessment process, consequently, inculcating confidence in the assessment processes and respectability of the education system in the society. Future Research: As future work, we propose a comparison between our tool and other such tools for its performance and its features. In addition, we want to extend our work to include testing for scalability of the tool to larger settings.




co

Printable Table of Contents. JITE: IIP, Volume 17, 2018

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 17, 2018




co

Constructed Response or Multiple-Choice Questions for Assessing Declarative Programming Knowledge? That is the Question!

Aim/Purpose: This paper presents a data mining approach for analyzing responses to advanced declarative programming questions. The goal of this research is to find a model that can explain the results obtained by students when they perform exams with Constructed Response questions and with equivalent Multiple-Choice Questions. Background: The assessment of acquired knowledge is a fundamental role in the teaching-learning process. It helps to identify the factors that can contribute to the teacher in the developing of pedagogical methods and evaluation tools and it also contributes to the self-regulation process of learning. However, better format of questions to assess declarative programming knowledge is still a subject of ongoing debate. While some research advocates the use of constructed responses, others emphasize the potential of multiple-choice questions. Methodology: A sensitivity analysis was applied to extract useful knowledge from the relevance of the characteristics (i.e., the input variables) used for the data mining process to compute the score. Contribution: Such knowledge helps the teachers to decide which format they must consider with respect to the objectives and expected students results. Findings: The results shown a set of factors that influence the discrepancy between answers in both formats. Recommendations for Practitioners: Teachers can make an informed decision about whether to choose multiple-choice questions or constructed-response taking into account the results of this study. Recommendation for Researchers: In this study a block of exams with CR questions is verified to complement the area of learning, returning greater performance in the evaluation of students and improving the teaching-learning process. Impact on Society: The results of this research confirm the findings of several other researchers that the use of ICT and the application of MCQ is an added value in the evaluation process. In most cases the student is more likely to succeed with MCQ, however if the teacher prefers to evaluate with CR other research approaches are needed. Future Research: Future research must include other question formats.




co

The Development of Computational Thinking in Student Teachers through an Intervention with Educational Robotics

Aim/Purpose: This research aims to describe and demonstrate the results of an intervention through educational robotics to improve the computational thinking of student teachers. Background: Educational robotics has been increasing in school classrooms for the development of computational thinking and digital competence. However, there is a lack of research on how to prepare future teachers of Kindergarten and Elementary School in the didactic use of computational thinking, as part of their necessary digital teaching competence. Methodology: Following the Design-Based Research methodology, we designed an intervention with educational robots that includes unplugged, playing, making and remixing activities. Participating in this study were 114 Spanish university students of education. Contribution: This research helps to improve the initial training of student teachers, especially in the field of educational robotics. Findings: The student teachers consider themselves digital competent, especially in the dimensions related to social and multimedia aspects, and to a lesser extent in the technological dimension. The results obtained also confirm the effectiveness of the intervention through educational robotics in the development of computational thinking of these students, especially among male students. Recommendations for Practitioners: Teacher trainers could introduce robotics following these steps: (1) initiation and unplugged activities, (2) gamified activities of initiation to the programming and test of the robots, (3) initiation activities to Scratch, and (4) design and resolution of a challenge. Recommendation for Researchers: Researchers could examine how interventions with educational robots helps to improve the computational thinking of student teachers, and thoroughly analyze gender-differences. Impact on Society: Computational thinking and robotics are one of the emerging educational trends. Despite the rise of this issue, there are still few investigations that systematize and collect evidence in this regard. This study allows to visualize an educational intervention that favors the development of the computational thinking of student teachers. Future Research: Researchers could evaluate not only the computational thinking of student teachers, but also their didactics, their ability to teach or create didactic activities to develop computational thinking in their future students.




co

Computer Science Education in Early Childhood: The Case of ScratchJr

Aim/Purpose: This paper aims to explore whether having state Computer Science standards in place will increase young children’s exposure to coding and powerful ideas from computer science in the early years. Background: Computer science education in the K-2 educational segment is receiving a growing amount of attention as national and state educational frameworks are emerging. By focusing on the app ScratchJr, the most popular free introductory block-based programming language for early childhood, this paper explores if there is a relationship between the presence of state frameworks and ScratchJr’s frequency of use. Methodology: This paper analyzes quantitative non-identifying data from Google Analytics on users of the ScratchJr programming app. Google Analytics is a free tool that allows access to user activity as it happens in real time on the app, as well as audience demographics and behavior. An analysis of trends by state, time of year, type of in-app activities completed, and more are analyzed with a specific focus on comparing states with K-12 Computer Science in place versus those without. Contribution: Results demonstrate the importance of having state standards in place to increase young children’s exposure to coding and powerful ideas from computer science in the early years. Moreover, we see preliminary evidence that states with Computer Science standards in place support skills like perseverance and debugging through ScratchJr. Findings: Findings show that in the case of ScratchJr, app usage decreases during the summer months and on weekends, which may indicate that coding with ScratchJr is more often happening in school than at home. Results also show that states with Computer Science standards have more ScratchJr users on average and have more total sessions with the app on average. Results also show preliminary evidence that states with Computer Science standards in place have longer average session duration as well as a higher average number of users returning to edit an existing project. Recommendations for Practitioners: Successful early childhood computer science education programs must teach powerful ideas from the discipline of computer science in a developmentally appropriate way, provide means for self-expression, prompt debugging and problem solving, and offer a low-floor/high-ceiling interface for both novices and experts. Practitioners should be aware in drops in computer science learning during the summer months when school is not in session. Recommendation for Researchers: Researchers should consider the impact of state and national frameworks on computer science learning and skills mastered during the early childhood years. Researchers should look for ways to continue engaging students in computer science education during times when school is not in session. Impact on Society: Results demonstrate the importance of having state CS standards in place to increase young children’s exposure to coding and powerful ideas from computer science in the early years. Moreover, we see preliminary evidence that states with Computer Science standards in place support skills like perseverance and debugging through ScratchJr. Future Research: Future research should continue collecting Google Analytics from the ScratchJr app and track changes in usage. Future research should also collect analytics from a wide range of programming applications for young children to see if the trends identified here are consistent across different apps.




co

Changing the Learning Environment: Teachers and Students’ Collaboration in Creating Digital Games

Aim/Purpose: The current study examines the impact of an intervention program to train teachers to collaborate with their students while creating digital games. Background: Teachers seem unable to leverage the potential of ICT to present students with a rich learning environment. ICT integration is usually at a relatively simple and concrete level without changing the traditional teacher-student paradigm. Methodology: The study is both quantitative and qualitative. Participants were 63 active teachers studying in the M.Ed. program at a teacher education college. The teachers responded to a series of pre- and post-questionnaires and wrote a concluding reflection. Contribution: Teaching based on creating digital games, combined with teacher-class collaboration, is a viable and real alternative of constructivist teaching, adapted to different learners. Findings: The SEM path analysis showed that it was only after the intervention that the lower the teachers’ resistance to changing teaching patterns, the higher their intrinsic motivation to learn an innovative pedagogical-technological program and likewise the sense of mastery of 21st-century skills, resulting in a positive attitude towards classroom collaboration. The qualitative findings reveal eight categories dealing with two main themes: the first is professional development, including conceptual, behavioral and emotional change, and the second is the teachers’ perception of the learners. Recommendations for Practitioners: Teacher training should be ongoing in order to change teaching-learning processes and promote an active approach based on constructive principles, 21st-century skills and collaboration between teachers and students in a computer environment. Recommendation for Researchers: Future studies should start by sampling teachers and education professionals who have convenient access to technology in their teaching-learning environment. Impact on Society: Collaboration between teachers and students in creating learning games in a computer environment and teacher-class collaboration, in general, require very different training than that which exists today. Hence there should be some rethinking of teacher training. The proposed pedagogical model is one such idea in the right direction. Future Research: A larger study with a greater number of participants, including a control group, should be conducted.




co

Concept–based Analysis of Java Programming Errors among Low, Average and High Achieving Novice Programmers

Aim/Purpose: The study examined types of errors made by novice programmers in different Java concepts with students of different ability levels in programming as well as the perceived causes of such errors. Background: To improve code writing and debugging skills, efforts have been made to taxonomize programming errors and their causes. However, most of the studies employed omnibus approaches, i.e. without consideration of different programing concepts and ability levels of the trainee programmers. Such concepts and ability specific errors identification and classifications are needed to advance appropriate intervention strategy. Methodology: A sequential exploratory mixed method design was adopted. The sample was an intact class of 124 Computer Science and Engineering undergraduate students grouped into three achievement levels based on first semester performance in a Java programming course. The submitted codes in the course of second semester exercises were analyzed for possible errors, categorized and grouped across achievement level. The resulting data were analyzed using descriptive statistics as well as Pearson product correlation coefficient. Qualitative analyses through interviews and focused group discussion (FGD) were also employed to identify reasons for the committed errors. Contribution:The study provides a useful concept-based and achievement level specific error log for the teaching of Java programming for beginners. Findings: The results identified 598 errors with Missing symbols (33%) and Invalid symbols (12%) constituting the highest and least committed errors respec-tively. Method and Classes concept houses the highest number of errors (36%) followed by Other Object Concepts (34%), Decision Making (29%), and Looping (10%). Similar error types were found across ability levels. A significant relationship was found between missing symbols and each of Invalid symbols and Inappropriate Naming. Errors made in Methods and Classes were also found to significantly predict that of Other Object concepts. Recommendations for Practitioners: To promote better classroom practice in the teaching of Java programming, findings for the study suggests instructions to students should be based on achievement level. In addition to this, learning Java programming should be done with an unintelligent editor. Recommendations for Researchers: Research could examine logic or semantic errors among novice programmers as the errors analyzed in this study focus mainly on syntactic ones. Impact on Society: The digital age is code-driven, thus error analysis in programming instruction will enhance programming ability, which will ultimately transform novice programmers into experts, particularly in developing countries where most of the software in use is imported. Future Research: Researchers could look beyond novice or beginner programmers as codes written by intermediate or even advanced programmers are still not often completely error free.




co

Printable Table of Contents. JITE: IIP, Volume 18, 2019

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 18, 2019




co

Rubric for Measuring and Visualizing the Effects of Learning Computer Programming for Elementary School Students

Aim/Purpose: Although many computer science measures have been proposed, visualizing individual students’ capabilities is difficult, as those measures often rely on specific tools and methods or are not graded. To solve these problems, we propose a rubric for measuring and visualizing the effects of learning computer programming for elementary school students enrolled in computer science education (CSE), which is independent of the programming language being used. Background: In this research, we proposed a rubric based on existing CSE standards and criteria having a programming education-learning goal. We then applied this rubric to actual lessons to visualize the educational effects. Methodology: The proposed new rubric for teaching computer programming, based on existing standards and criteria, was applied to fourth- and sixth-grade students in Japan. We assessed which skills were cultivated through quizzes before and after the teaching. Contribution: This paper contributes on how to make and utilize a rubric for programming education in computer science. We evaluated and visualized the proposed rubric’s learning effects on children and found that our proposed rubrics are independent of any particular method or tool. Findings: The results of this survey are twofold: (1) we proposed a rubric of programming education in computer science, independent of the programming tools used and (2) we succeeded in visualizing students’ learning stages by applying the proposed rubric to programming education conducted in a Japanese elementary school. Recommendations for Practitioners: Evaluating educational effects in CSE is important. In particular, graded assessments of learner abilities can reveal individual characteristics. This research is useful for assessing CSE because it focuses specifically on programming education. Recommendation for Researchers: The rubric’s suggestions and quality improvements in CSE help learners assess their learning progress and will clarify the cultivated computer science skills. Impact on Society: This research evaluates CSE based on a rubric in the programming education field. Future Research: Future work is needed to improve the proposed rubric’s quality and relevance. Also, this rubric should be applied to many classes to increase the number of evaluations and analyses.




co

Improving Workgroup Assessment with WebAVALIA: The Concept, Framework and First Results

Aim/Purpose: The purpose of this study is to develop an efficient methodology that can assist the evaluators in assessing a variable number of individuals that are working in groups and guarantee that the assessment is dependent on the group members’ performance and contribution to the work developed. Background: Collaborative work has been gaining more popularity in academic settings. However, group assessment needs to be performed according to each individual’s performance. The problem rests on the need to distinguish each member of the group in order to provide fair and unbiased assessments. Methodology: Design Science Research methodology supported the design of a framework able to provide the evaluator with the means to distinguish individuals in a workgroup and deliver fair results. Hevner’s DSR guidelines were fulfilled in order to describe WebAVALIA. To evaluate the framework, a quantitative study was performed and the first results are presented. Contribution: This paper provides a methodological solution regarding a fair evaluation of collaborative work through a tool that allows its users to perform their own assessment and peer assessment. These are made accordingly to the user’s perspectives on the performance of each group member throughout the work development. Findings: The first analysis of the results indicates that the developed method provides fairness in the assessment of group members, delivering a distinction amongst individuals. Therefore, each group member obtains a mark that corresponds to their specific contribution to the workgroup. Recommendations for Practitioners: For those who intend to apply this workgroup assessment method, it is relevant to raise student awareness about the methodology that is going to be used. That is, all the functionalities and steps in WebAVALIA have to be thoroughly explained before beginning of the project. Then, the evaluators have to decide about the students’ intermediate voting, namely if the evaluator chooses or not to publish student results throughout the project’s development. If there is the decision to display these intermediate results, the evaluator must try to encourage collaboration among workgroup members, instead of competition. Recommendation for Researchers: This study explores the design and development of an e-assessment tool – WebAVALIA. In order to assess its feasibility, its use in other institutions or contexts is recommended. The gathering of user opinions is suggested as well. It would then be interesting to compare the findings of this study with the results from other experimentations Impact on Society: Sometimes, people develop a rejection of collaborative work because they feel exploited due to the biased evaluation results. However, the group members assessment distinction, according to each one’s performance, may give each individual a sense of fairness and reward, leading to an openness/willingness towards collaborative work. Future Research: As future work, there are plans to implement the method in other group assessment contexts – such as sports and business environments, other higher education institutions, technical training students – in other cultures and countries. From this myriad of contexts, satisfaction results would be compared. Other future plans are to further explore the mathematical formulations and the respective WebAVALIA supporting algorithms.




co

Redesigning an Introductory Programming Course to Facilitate Effective Student Learning: A Case Study

Aim/Purpose: This study reports the outcome of how a first pilot semester introductory programming course was designed to provide tangible evidence in support of the concept of Student Ownership of Learning (SOL) and how the outcomes of this programming course facilitate effective student learning. Background: Many instructors want to create or redesign their courses to strengthen the relationship between teaching and learning; however, the researchers of this study believe that the concept of Student Ownership of Learning (SOL) connects to student engagement and achievement in the classroom setting. The researchers redesigned the introductory programming course to include valuable teaching methods to increase Student Ownership of Learning and constructive approaches such as making students design an authentic mobile app project as individuals, partners, or within teams. The high quality of students’ projects positioned them as consultants to the university IT department. Methodology: This paper employs a case study design to construct a qualitative research method as it relates to the phenomenon of the study’s goals and lived experiences of students in the redesigned introductory programming course. The redesigned course was marketed to students as a new course with detailed description and elements that were different from the traditional computer science introductory programming course requirement. The redesigned introductory programming course was offered in two sections: one section with 14 registered students and the other section with 15 registered students. One faculty member instructed both sections of the course. A total of 29 students signed up for the newly redesigned introductory programming course, more than in previous semesters, but two students dropped out within the first two weeks of the redesigned course making a total of 27 students. The redesigned coursework was divided into two parts of the semester. The first part of the semester detailed description and elements of the coursework including a redesigned approach with preparation for class, a quiz, and doing homework in class, which gives students control of decisions whenever possible; and working with each other, either with a partner or in a team. The second part of the semester focuses on students designing a non-trivial working mobile app and presenting their developing mobile app at a significant public competition at the end of the semester. Students developed significantly complex mobile apps and incorporated more complex functionality in their apps. Both Management Information System (MIS) major students and Computer Science major students were in the same course despite the fact that MIS students had never taken a programming course before; however, the Computer Science students had taken at least one course of programming. Contribution: This study provides a practical guide for faculty members in Information Technology programs and other faculty members in non-Computer Science programs to create or redesign an introductory course that increases student engagement and achievement in the classroom based on the concept of Student Ownership of Learning (SOL). This study also deepens the discussion in curriculum and instruction on the value to explore issues that departments or programs should consider when establishing coursework or academic programs. Findings: This study found two goals evidently in support to increase Student Ownership of Learning (SOL). The first goal (Increase their ownership of learning SOL) showed that students found value in the course contents and took control of their learning; therefore, the faculty no longer had to point out how important different programming concepts were. The students recognized their own learning gap and were excited when shown a programming concept that addressed the gap. For example, student comments were met with “boy, we can really use this in our app” instead of comments about how complex they were. The coursework produced a desired outcome for students as they would get the knowledge needed to make the best app that they could. The second goal (Develop a positive attitude toward the course) showed positive results as students developed a more positive attitude towards the course. Student actions in the classroom strongly reflected a positive attitude. Attendance was almost 100% during the semester even though no points for attendance were given. Further evidence of Student Ownership of Learning and self-identity was students’ extensive use of the terminology and concept of the course when talking to others, especially during the public competition. Students were also incorporating their learning into their identities. For example, teams became known by their app such as the Game team, the Recipe team, and the Parking team. One team even made team t-shirts. Another exciting reflection of the Student Ownership of Learning which occurred was the learning students did by themselves. Recommendations for Practitioners: Practitioners can share best practices with faculty in different departments, programs, universities, and educational consultants to cultivate the best solution for Student Ownership of Learning based on student engagement and achievement in the classroom setting. Recommendation for Researchers: Researchers can explore different perspectives with scholars and practitioners in various disciplinary fields of study to create or redesign courses and programs to reflect Student Ownership of Learning (SOL). Impact on Society: Student Ownership of Learning is relevant for faculty and universities to incorporate in the creation or redesigning of coursework in academic programs. Readers can gain an understanding that student engagement and achievement are two important drivers of Student Ownership of Learning (SOL) in the classroom setting. Future Research: Practitioners and researchers could follow-up in the future with a study to provide more understanding and updated research information from different research samples and hypotheses on Student Ownership of Learning (SOL).




co

Novice Programmers’ Coping with Multi-Threaded Software Design

Aim/Purpose: Multi-threaded software design is considered to be difficult, especially to novice programmers. In this study, we explored how students cope with a task that its solution requires a multi-threaded architecture to achieve optimal runtime. Background: An efficient exploit of multicore processors architecture requires computer programs that use parallel programming techniques. However, parallel programming is difficult to understand and apply by novice programmers. Methodology: The students had to address a two-stage problem: (1) design an optimal runtime solution to a given problem with no additional instructions; and (2) provide an optimal runtime multi-threaded design to the same problem. Interviews were conducted with a representative group of students to understand the underlying causes of their provided designs. We used qualitative research methods to gain refined insights regarding the students’ decision making during the design process. To analyze the gained data, we used content analysis tools. Contribution: The case study presented in this paper will help the teacher to stress the merits and limitations of various parallel architectures and confront students with the consequences of their solutions via performances’ benchmark. Findings: Analysis of the student’s solutions to the first stage revealed that the majority of them did not provide a multi-threaded solution ignoring the optimal runtime requirement. At the second stage, seven various architectures were provided differing in the number of involved threads, the data structures used, and the synchronization mechanism employed. The majority of the solutions were sub-optimal and only a few students provided an optimal one. Recommendations for Practitioners: We recommend conducting class discussions that will follow a task similar to the one used in this study. Recommendation for Researchers: To be able to generalize the received results this research should be repeated with larger study participant groups from various academic institutions. Impact on Society: Understanding the difficulties of novice programmers may lead to quality software systems. Future Research: To be able to generalize the received results this research should be repeated with larger study participant groups from various academic institutions.




co

Design and Delivery of an Online Information Systems Management Course for MBA Programs

Aim/Purpose: In this paper, we present our experience in design and delivery of a graduate Information Systems Management (ISM) course in an online MBA program. Also presented are a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Background: This graduate ISM course needs to not only cover a broad range of dynamic technology and business topics, but also strike a balance between the width and depth of the content. Effective course design and delivery are critical to improved teaching and learning, especially when the course is delivered online. Methodology: We provided a comprehensive review of the related literature to develop guidelines for the design and delivery of our ISM course; we collected survey data to evaluate the students’ backgrounds and their perceptions of the course; we used data analysis and content analysis methods to assess the course evaluation results. Contribution: A review of the related literature indicates that IS researchers and educators have not adequately studied online graduate education. Given the importance of the graduate ISM course in most MBA programs, and the lack of attention from the IS community, it is critical to address this gap in the research. We believe we have done so with this paper. Findings: The paper’s major findings are embedded in a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Recommendations for Practitioners: Even though our experience may not be fully applicable to other institutions, we hope our IS colleagues can learn from the design and delivery of this online course, as well as our best practices and lessons learned to improve the teaching and learning effectiveness in IS online graduate education, in general. Furthermore, we provide instructors with an actionable framework onto which they can map their current course offering, and compare their current pedagogical offering to literature driven best practices for ISM courses, in particular. Recommendation for Researchers: It is our hope that the design and delivery of this online course, and our best practices and lessons learned can inspire our IS colleagues to search for innovative ways to improve the teaching and learning effectiveness in IS online graduate education. In addition, we distill a literature driven framework for ISM courses design and delivery that can help researchers frame their pedagogical research questions. Impact on Society: The online course in this study prepares students for more efficiently and effectively delivering IT systems in organizations. Many MBA students work for non-profits and other socially-focused organizations and are able to use the skills learned in the course for the betterment of society. Future Research: We will continue to monitor the impact of the changes on student learning effectiveness and attempt to identify additional innovative ways to improve the design and delivery of this online ISM course.




co

Incorporating Kinesthetic Learning into University Classrooms: An Example from Management Information Systems

Aim/Purpose: Students tend to learn best when an array of learning styles is used by instructors. The purpose of this paper is to add, to introduce, and to apply the concepts of kinesthetic learning and learning structures to university and STEM education. Background: The study applies the concept of kinesthetic learning and a learning structure called Think-Pair-Share to an experiential exercise about Moore’s Law in an introductory MIS classroom. The paper details the exercise and each of its components. Methodology: Students in two classes were asked to complete a short survey about their conceptual understanding of the course material before and after the experiential exercise. Contribution: The paper details the benefits of kinesthetic learning and learning structures and discusses how to apply these concepts through an experiential exercise used in an introductory MIS course. Findings: Results indicate that the kinesthetic learning activity had a positive impact on student learning outcomes. Recommendations for Practitioners: University educators can use this example to structure several other learning activities that apply kinesthetic learning principles. Recommendation for Researchers: Researchers can use this paper to study more about how to incorporate kinesthetic learning into education, and about teaching technology concepts to undergraduate students through kinesthetic learning. Impact on Society: The results of this study may be extremely beneficial for the university and STEM community and overall academic business community. Future Research: Researchers should consider longitudinal studies and other ways to incorporate kinesthetic learning activities into education.




co

Printable Table of Contents. JITE: IIP, Volume 19, 2020

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 19, 2020




co

The Effect of E-Learning Experience on Readiness, Attitude, and Self-Control/Self-Management

Aim/Purpose: This study aimed to reveal the effect of the previous Internet-based education (IBE) experiences of the students’ readiness, attitude, and self-control / self-management variables towards the e-learning process, and also to determine their opinions. Background: The institutions have made efforts to ensure the continuity of education through their learning management systems and the necessity of addressing the e-learning process from the perspective of students once again showed itself as an undeniable fact. Accordingly, the necessity to consider holistically the variables of readiness, attitude, and self-control/self-management, which affect students’ adaptation to e-learning process, has once again emerged based on the relevant literature. Methodology: This research based on the simultaneous mixed method considering the previous IBE experiences of 75 Computer Education and Instructional Technology (CEIT) students taking part in the study in Turkey. The quantitative results of the study were analyzed based on the single-group pretest-posttest weak experimental design. Qualitative results were obtained through the structured interview form and set an example for the case study. Contribution: The results showed that regardless of students’ previous Internet-based education (IBE) experience, it is seen that increasing and continuous experience has a significant effect on the readiness, attitude and self-control / self-management variables towards the e-learning process. The main contribution of experimental results showed that IBE experience is effective on individuals’ perceptions of internet self-efficacy, and has an impact on the self-learning skills of individuals. In addition to this, the e-learning experience has an impact on individuals’ self-evaluation. It is also seen that the certificate presented to learners in the e-learning environment has a positive effect on students’ attitudes towards e-learning processes. Finally, the experiences of e-learning processes, the methods used to transfer the content in the learning environment, the motivation and feedback provided to the learner also support the significant difference obtained in terms of readiness, attitude and self-control / self-management. Findings: After the findings were analyzed holistically in depth, it has been observed that; if the contents offered to students in e-learning environments support their professional development, in this case, their attitudes, readiness (excluding the sub-dimension of learner control), and self-control/self-management skills for these environments differ significantly in the posttest. It is also among the results that students having previous IBE experience have not higher awareness levels on online communication self-efficacy, technology use self-efficacy, readiness for e-learning, e-learning predisposition, self-reinforcement, self-control management, although significantly found. The findings regarding the effectiveness of the experimental process are as follows: Although it is possible for the students having previous IBE experience to use these experiences within the course for their personal development, it has been seen that the observed differences regarding students’ readiness, attitude, and self-control/self-management towards e-learning processes arise from the experimental operation. Recommendations for Practitioners: It is recommended for the policy-makers and practitioners that while e-learning platforms were designing, using different methods for delivering the content is as important as making the interaction meaningful and sustainable. In addition to this, to develop a positive attitude it is recommended that individuals’ participation of an e-learning platform should be supported with a certificate. Recommendation for Researchers: Researchers should test the obtained results by a well-structured e-learning platform with their recorded activities on the platform (e.g. in which section was used mostly by a learner etc.). Hence, the impact of IBE experiences might be discussed in an up level framework. Impact on Society: Actually, this study is based on a mix design and the results were also meaningful especially considering the implacable global pandemic. It is clearly understood by this process that e-learning is very important. In line with this, to support the e-learning process (e.g. with the method while delivering the content, well-structured feedback, motivation strategies etc.) and make it sustainable, the increasing of individual’s readiness, attitude, and self-control through the IBE would be indispensable. Future Research: Future studies might focus on the longitudinal methods. It is worth to find out how the students experiences affect the sustainability of the course content, and what should the program developer make to improve their course content in line with the findings of longitudinal studies.




co

A Cognitive Approach to Assessing the Materials in Problem-Based Learning Environments

Aim/Purpose: The purpose of this paper is to develop and evaluate a debiasing-based approach to assessing the learning materials in problem-based learning (PBL) environments. Background: Research in cognitive debiasing suggests nine debiasing strategies improve decision-making. Given the large number of decisions made in semester-long, problem-based learning projects, multiple tools and techniques help students make decisions. However, instructors may struggle to identify the specific tools or techniques that could be modified to best improve students’ decision-making in the project. Furthermore, a structured approach for identifying these modifications is lacking. Such an approach would match the debiasing strategies with the tools and techniques. Methodology: This debiasing framework for the PBL environment is developed through a study of debiasing literature and applied within an e-commerce course using the Model for Improvement, continuous improvement process, as an illustrative case to show its potential. In addition, a survey of the students, archival information, and participant observation provided feedback on the debiasing framework and its ability to assess the tools and techniques within the PBL environment. Contribution: This paper demonstrates how debiasing theory can be used within a continuous improvement process for PBL courses. By focusing on a cognitive debiasing-based approach, this debiasing framework helps instructors 1) identify what tools and techniques to change in an PBL environment, and 2) assess which tools and techniques failed to debias the students adequately, providing potential changes for future cycles. Findings: Using the debiasing framework in an e-commerce course with significant PBL elements provides evidence that this framework can be used within IS courses and more broadly. In this particular case, the change identified in a prior cycle proved effective and additional issues were identified for improvement. Recommendations for Practitioners: With the growing usage of semester-long PBL projects in business schools, instructors need to ensure that their design of the projects incorporates techniques that improve student learning and decision making. This approach provides a means for assessing the quality of that design. Recommendation for Researchers: This study uses debiasing theory to improve course techniques. Researchers interested in assessment, course improvement, and program improvement should incorporate debiasing theory within PBL environments or other types of decision-making scenarios. Impact on Society: Increased awareness of cognitive biases can help instructors, students, and professionals make better decisions and recommendations. By developing a framework for evaluating cognitive debiasing strategies, we help instructors improve projects that prepare students for complex and multifaceted real-world projects. Future Research: The approach could be applied to multiple contexts, within other courses, and more widely within information systems to extend this research. The framework might also be refined to make it more concise, integrated with assessment, or usable in more contexts.




co

Printable Table of Contents. JITE: IIP, Volume 20, 2021

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 20, 2021




co

Knowledge Management Applied to Learning English as a Second Language Through Asynchronous Online Instructional Videos

Aim/Purpose: The purpose of this research is to determine whether ESL teaching videos as a form of asynchronous online knowledge sharing can act as an aid to ESL learners internalizing knowledge in language acquisition. In this context, internalizing knowledge carries the meaning of being able to remember language, and purposefully and accurately use it context, including appropriacy of language, and aspects of correct pronunciation, intonation, stress patterns and connected speech, these being the elements of teaching and practice that are very often lacking in asynchronous, online, instructional video. Background: Knowledge Management is the field of study, and the practice, of discovering, capturing, sharing, and applying knowledge, typically with a view to translating individuals’ knowledge into organizational knowledge. In the field of education, it is the sharing of instructors’ knowledge for students to be able to learn and usefully apply that knowledge. In recent pandemic times, however, the mode of instruction has, of necessity, transitioned from face-to-face learning to an online environment, transforming the face of education as we know it. While this mode of instruction and knowledge sharing has many advantages for the online learner, in both synchronous and asynchronous learning environments, it presents certain challenges for language learners due to the absence of interaction and corrective feedback that needs to take place for learners of English as a Second Language (ESL) to master language acquisition. Unlike other subjects where the learner has recourse to online resources to reinforce learning through referencing external information, such as facts, figures, or theories, to be successful in learning a second language, the ESL learner needs to be able to learn to process thought and speech in that language; essentially, they need to learn to think in another language, which takes time and practice. Methodology: The research employs a systematic literature review (SLR) to determine the scope and extent to which the subject is covered by existing research in this field, and the findings thereof. Contribution: Whilst inconclusive in relation to internalizing language through online, asynchronous instructional video, through its exploratory nature, the research contributes towards the body of knowledge in online learning through the drawing together of various studies in the field of learning through asynchronous video through improving video and instructional quality. Findings: The findings of the systematic literature review revealed that there is negligible research in this area, and while information exists on blended and flipped modes of online learning, and ways to improve the quality and delivery of instructional video generally, no prior research on the exclusive use of asynchronous videos as an aid to internalizing English as a second language were found. Recommendations for Practitioners: From this research, it is apparent that there is considerably more that practitioners can do to improve the quality of instructional videos that can help students engage with the learning, from which students stand a much better chance of internalizing the learning. Recommendation for Researchers: For researchers, the absence of existing research is an exciting opportunity to further explore this field. Impact on Society: Online learning is now globally endemic, but it poses specific challenges in the field of second language learning, so the development of instructional videos that can facilitate this represents a clear benefit to all ESL learners in society as a whole. Future Research: Clearly the absence of existing research into whether online asynchronous instructional videos can act as an aid to internalizing the acquisition of English as a second language would indicate that this very specific field is one that merits future research. Indeed, it is one that the author intends to exploit through primary data collection from the production of a series of asynchronous, online, instructional videos.




co

Perceptions of Senior Academic Staff in Colleges of Education Regarding Integration of Technology in Online Learning

Aim/Purpose: The goal of the study was to examine the perceptions of senior academic staff who also serve as policymakers in Israeli colleges of education, regarding the integration of technology in teacher education, and the shift to online learning during the Covid-19 pandemic. There is little research on this issue and consequently, the aim of the present study is to fill this lacuna. Background: In Israel, senior academic staff in colleges of education play a particularly important role in formulating institutional policies and vision regarding the training of preservice teachers. They fulfil administrative functions, teach, and engage in research as part of their academic position. During the Covid-19, they led the shift to online learning. However, there is little research on their perceptions of technology integration in teacher education in general, and during the Covid-19, in particular. Methodology: This qualitative study conducted semi-structured interviews with 25 senior academic staff from 13 academic colleges of education in Israel. Contribution: The study has practical implications for the implementation of technology in teacher education, suggesting the importance of establishing open discourse and collaboration between college stakeholders to enable enactment of a vision for equity-that allows programs to move swiftly from crisis-management to innovation and transformation during the Covid-19 pandemic. Findings: The findings obtained from content analysis of the interviews reveals a central concept: “On both sides of the divide”, and points of intersection in the perceptions of the senior academic staff. The central concept encompassed three themes: (1) centralization - between top-down and bottom-up policies, (2) between innovation and conservation, and (3) between crisis and growth. The findings indicate that in times of crisis, the polarity surrounding issues essential to the organisation’s operation is reduced, and a blend is formed to create a new reality in which the various dichotomies merge. Recommendations for Practitioners: The study has practical implications for the scope of discussions on the implementation of technology in teacher education (formulating a vision and policies, and their translation into practice), suggesting that such discussions should consider the perceptions of policymakers. Recommendation for Researchers: The findings reflect the challenges faced by senior academic staff at colleges of education that reflect the ongoing attempts to negotiate and reconcile different concerns. Impact on Society: The findings have implications for colleges of education that are responsible for pre-service teachers' teaching practices. Future Research: An enacted vision for equity-based educator preparation that allows programs to move swiftly from crisis-management to innovation and transformation. Future research might reveal a more complete picture by investigating a broader spectrum of stakeholders both in Israel and elsewhere. Hence, future research should examine the power relations between senior college staff and external bodies such as the Higher Education Council (which determines higher education policies in Israel).




co

Categorizing Well-Written Course Learning Outcomes Using Machine Learning

Aim/Purpose: This paper presents a machine learning approach for analyzing Course Learning Outcomes (CLOs). The aim of this study is to find a model that can check whether a CLO is well written or not. Background: The use of machine learning algorithms has been, since many years, a prominent solution to predict learner performance in Outcome Based Education. However, the CLOs definition is still presenting a big handicap for faculties. There is a lack of supported tools and models that permit to predict whether a CLO is well written or not. Consequently, educators need an expert in quality and education to validate the outcomes of their courses. Methodology: A novel method named CLOCML (Course Learning Outcome Classification using Machine Learning) is proposed in this paper to develop predictive models for CLOs paraphrasing. A new dataset entitled CLOC (Course Learning Outcomes Classes) for that purpose has been collected and then undergone a pre-processing phase. We compared the performance of 4 models for predicting a CLO classification. Those models are Support Vector Machine (SVM), Random Forest, Naive Bayes and XGBoost. Contribution: The application of CLOCML may help faculties to make well-defined CLOs and then correct CLOs' measures in order to improve the quality of education addressed to their students. Findings: The best classification model was SVM. It was able to detect the CLO class with an accuracy of 83%. Recommendations for Practitioners: We would recommend both faculties’ members and quality reviewers to make an informed decision about the nature of a given course outcome. Recommendation for Researchers: We would highly endorse that the researchers apply more machine learning models for CLOs of various disciplines and compare between them. We would also recommend that future studies investigate on the importance of the definition of CLOs and its impact on the credibility of Key Performance Indicators (KPIs) values during accreditation process. Impact on Society: The findings of this study confirm the results of several other researchers who use machine learning in outcome-based education. The definition of right CLOs will help the student to get an idea about the performances that will be measured at the end of a course. Moreover, each faculty can take appropriate actions and suggest suitable recommendations after right performance measures in order to improve the quality of his course. Future Research: Future research can be improved by using a larger dataset. It could also be improved with deep learning models to reach more accurate results. Indeed, a strategy for checking CLOs overlaps could be integrated.




co

Using Design-Based Research to Layer Career-Like Experiences onto Software Development Courses

Aim/Purpose: This research aims to describe layering of career-like experiences over existing curriculum to improve perceived educational value. Background: Feedback from students and regional businesses showed a clear need to increase student’s exposure to career-like software development projects. The initial goal was to develop an instructor-optional project that could be used in a single mid-level programming course; however, the pilot quickly morphed into a multi-year study examining the feasibility of agile projects in a variety of settings. Methodology: Over the course of four years, an agile project was honed through repeated Design Based Research (DBR) cycles of design, implementation, testing, communication, and reflective analysis. As is common with DBR, this study did not follow single methodology design; instead, analysis of data coupled with review of literature led to exploration and testing of a variety of methodologies. The review phase of each cycle included examination of best practices and methodologies as determined by analysis of oral and written comments, weekly journals, instructor feedback, and surveys. As a result of participant feedback, the original project was expanded to a second project, which was tested in another Software Engineering (SE) course. The project included review and testing of many academic and professional methodologies, such as Student Ownership of Learning, Flipped Classroom, active learning, waterfall, agile, Scrum, and Kanban. The study was homogenous and quasi-experimental as the population consisted solely of software engineering majors taking required courses; as based on validity of homogenous studies, class sizes were small, ranging from 8 to 20 students. Close interactions between respondents and the instructor provided interview-like settings and immersive data capture in a natural environment. Further, the iterative development practices of DBR cycles, along with the inclusion of participants as active and valued stakeholders, was seen to align well with software development practitioner practices broadly known as agile. Contribution: This study is among the first to examine layering a career-like software development project on top of a course through alteration of traditional delivery, agile development, and without supplanting existing material. Findings: In response to industry recommendations for additional career-like experiences, a standalone agile capstone-like project was designed that could be layered over an existing course. Pilot data reflected positive perceptions of the project, although students did not have enough time to develop a working prototype in addition to completing existing course materials. Participant feedback led to simultaneous development of a second, similar project. DBR examination of both projects resulted in a simplified design and the ability to develop a working prototype, if and only if the instructor was willing to make adjustments to delivery. After four years, a solution was developed that is both stable and flexible. The solution met the original charge in that it required course delivery, not course material, to be adjusted. It is critical to note that when a working prototype is desired, a portion of the lecture should be flipped allowing more time for guided instruction through project-focused active learning and study group requirements. The results support agile for standalone software development projects, as long as passive delivery methods are correspondingly reduced. Recommendations for Practitioners: Based on the findings, implementation of a career-like software development project can be well received as long as active learning components are also developed. Multiple cycles of DBR are recommended if future researchers wish to customize instructional delivery and develop complex software development projects. Programming instructors are recommended to explore hybrid delivery to support development of agile career-like experiences. Small class sizes allowed the researchers to maintain an interview-like setting throughout the study and future studies with larger classes are recommended to include additional subject matter experts such as graduate students as interaction with a subject matter expert was highly valued by students. Recommendation for Researchers: Researchers are recommended to further examine career-like software development experiences that combine active learning with agile methods; more studies following agile and active learning are needed to address the challenges faced when complex software development is taught in academic settings. Further testing of standalone agile project development has now occurred in medium sized in person classes, online classes, independent studies, and creative works research settings; however, further research is needed. Future research should also examine the implementation of agile projects in larger class sizes. Increasing class size should be coupled with additional subject matter experts such as graduate students. Impact on Society: This study addresses professional recommendations for development of agile career-like experiences at the undergraduate level. This study provides empirical evidence of programming projects that can be layered over existing curriculum, with no additional cost to the students. Initial feedback from local businesses and graduates, regarding agile projects with active learning, has been positive. The area business that refused to hire our underprepared SE graduates has now hired several. Future Research: Future research should explore layering agile projects over a broader range of software development courses. Feedback from hiring professionals and former students has been positive. It is also recommended that DBR be used to develop career-like experiences for online programming courses.




co

Printable Table of Contents. JITE: IIP, Volume 21, 2022

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 21, 2022




co

Unveiling the Digital Equation Through Innovative Approaches for Teaching Discrete Mathematics to Future Computer Science Educators

Aim/Purpose: This study seeks to present a learning model of discrete mathematics elements, elucidate the content of teaching, and validate the effectiveness of this learning in a digital education context. Background: Teaching discrete mathematics in the realm of digital education poses challenges, particularly in crafting the optimal model, content, tools, and methods tailored for aspiring computer science teachers. The study draws from both a comprehensive review of relevant literature and the synthesis of the authors’ pedagogical experiences. Methodology: The research utilized a system-activity approach and aligned with the State Educational Standard. It further integrated the theory of continuous education as its psychological and pedagogical foundation. Contribution: A unique model for instructing discrete mathematics elements to future computer science educators has been proposed. This model is underpinned by informative, technological, and personal competencies, intertwined with the mathematical bedrock of computer science. Findings: The study revealed the importance of holistic teaching of discrete mathematics elements for computer science teacher aspirants in line with the Informatics educational programs. An elective course, “Elements of Discrete Mathematics in Computer Science”, comprising three modules, was outlined. Practical examples spotlighting elements of mathematical logic and graph theory of discrete mathematics in programming and computer science were showcased. Recommendations for Practitioners: Future computer science educators should deeply integrate discrete mathematics elements in their teaching methodologies, especially when aligning with professional disciplines of the Informatics educational program. Recommendation for Researchers: Further exploration is recommended on the seamless integration of discrete mathematics elements in diverse computer science curricula, optimizing for varied learning outcomes and student profiles. Impact on Society: Enhancing the quality of teaching discrete mathematics to future computer science teachers can lead to better-educated professionals, driving advancements in the tech industry and contributing to societal progress. Future Research: There is scope to explore the wider applications of the discrete mathematics elements model in varied computer science sub-disciplines, and its adaptability across different educational frameworks.




co

Gamification of Statistics and Probability Education: A Mobile Courseware Approach

Aim/Purpose: The study examined how the developed mobile courseware can be used as instructional material to improve senior high school statistics and probability learning, particularly during distance learning caused by the COVID-19 pandemic. The study also aims to assess the gamified mobile courseware’s engagement, functionality, aesthetics, and information quality using the Mobile App Rating Scale (MARS) and a researcher-made Gamified Mobile Courseware Assessment Tool (GMCET). Background: The need to investigate the effectiveness of incorporating game-based elements into mathematics courses through innovative instructional materials inspired the study. The COVID-19 pandemic has made distance learning a necessity, and gamified mobile courseware is a potential solution to improve learning outcomes and engagement in mathematics courses. Methodology: The study employed a descriptive-evaluative method with quantitative and qualitative data to achieve its objectives. Five IT practitioners assessed the developed courseware using the MARS regarding engagement, functionality, aesthetics, and information. A researcher-made GMCET was also used to evaluate the app’s content quality, learning objectives, content presentation, learning assessment, and usability. Five math experts and 12 math teachers rated the app using the GMCET. The study used weighted mean to analyze the quantitative data and content analysis for the qualitative data. Contribution: The study provides insights into the strengths and weaknesses of gamified mobile courseware from the perspective of IT practitioners, math experts, and math teachers. The study’s findings can inform improvements in future iterations of courseware, and the study provides a valuable guide for practitioners looking to develop gamified mobile courseware for mathematics courses. Findings: The quantitative results based on the weighted mean indicate that the IT practitioners had a moderately positive perception of the developed courseware across all categories. At the same time, the math teachers and math experts showed highly positive perceptions of the gamified mobile courseware in Statistics and Probability, rating it highly across all categories. The qualitative data analysis through content analysis highlights the need for improving the user interface, usability, user experience design, user control, flexibility in interaction, data quality, reliability, and user privacy of the developed app. Recommendations for Practitioners: Practitioners can use the study’s findings to improve the design of gamified mobile courseware for mathematics courses and other content areas. The study recommends that practitioners focus on improving the user interface, usability, user experience design, user control, flexibility in interaction, data quality, reliability, and user privacy of gamified mobile courseware. Recommendation for Researchers: Future research can build on this study’s findings by exploring the use of gamified mobile courseware in other mathematical courses and other subject areas. Further research can also examine how gamified mobile courseware can improve learning outcomes for students with different learning needs. Impact on Society: The study’s findings could improve the effectiveness of gamified mobile courseware in enhancing student learning outcomes in mathematics courses. This can lead to better student performance, improved engagement, and increased interest in mathematics courses, positively impacting society. Future Research: Future research can explore using gamified mobile courseware in other mathematics courses and other subject areas. Additionally, future studies can examine how gamified mobile courseware can improve learning outcomes for students with different learning needs. Further research can also investigate the impact of gamified mobile courseware on student motivation, interest, and performance in mathematics courses.




co

COVID-19 Pandemic and the Use of Emergency Remote Teaching (ERT) Platforms: Lessons From a Nigerian University

Aim/Purpose: This study examines the use of the Emergency Remote Teaching (ERT) platform by undergraduates of the University of Ibadan, Nigeria, during the COVID-19 pandemic using the constructs of the UTAUT2 model. Five constructs of the UTAUT2 model were adopted to investigate the use of the ERT platform by undergraduates of the university. Background: The Coronavirus (COVID-19) outbreak disrupted academic activities in educational institutions, leading to an unprecedented school closure globally. In response to the pandemic, higher educational institutions adopted different initiatives aimed at ensuring the uninterrupted flow of their teaching and learning activities. However, there is little research on the use of ERT platforms by undergraduates in Nigerian universities. Methodology: The descriptive survey research design was adopted for the study. The multi-stage random sampling technique was used to select 334 undergraduates at the University of Ibadan, Nigeria, while a questionnaire was used to collect data from 271 students. Quantitative data were collected and analyzed using frequency counts, percentages, mean and standard deviation, Pearson Product Moment Correlation, and regression analysis. Contribution: The study contributes to understanding ERT use in the educational institutions of Nigeria – Africa’s most populous country. Furthermore, the study adds to the existing body of knowledge on how the UTAUT2 Model could explain the use of information technologies in different settings. Findings: Findings revealed that there was a positive significant relationship between habit, hedonic motivation, price value, and social influence on the use of ERT platforms by undergraduates. Hedonic motivation strongly predicted the use of ERT platforms by most undergraduates. Recommendations for Practitioners: As a provisional intervention in times of emergencies, the user interface, navigation, customization, and other aesthetic features of ERT platforms should be more appealing and enjoyable to ensure their optimum utilization by students. Recommendation for Researchers: More qualitative research is required on users’ satisfaction, concerns, and support systems for ERT platforms in educational institutions. Future studies could consider the use of ERT by students in different countries and contexts such as students participating in English as a Foreign Language (EFL) and the English for Speakers of other languages (ESOL) programs. Impact on Society: As society faces increased uncertainties of the next global pandemic, this article reiterates the crucial roles of information technology in enriching teaching and learning activities in educational institutions. Future Research: Future research should focus on how different technology theories and models could explain the use of ERT platforms at different educational institutions in other geographical settings and contexts.




co

MOOC Appropriation and Agency in Face-to-Face Learning Communities

Aim/Purpose: The emergence of massive open online courses (MOOCs) has fostered the creation of co-located learning communities; however, there is limited research on the types of interactions unfolding in these spaces. Background: This study explores Peer 2 Peer University’s Learning Circles, a project that allows individuals to take MOOCs together at the library. I investigated the patterns that emerged from the interactions between facilitators, learners, course materials, and digital media in the pilot round of these Learning Circles. Methodology: This study employs an ethnography of hybrid spaces (online/offline participant observations, in-depth interviews, and artifact collection) of face-to-face study groups taking place at library branches in a Midwest metropolitan area. Data analysis employs the constant comparison method. Contribution: Interactions taking place in the Learning Circles increased individuals’ agency as learners and subverted the MOOC model through processes of technological appropriation. Findings: The findings reveal that interactions within Learning Circles created a dynamic negotiation of roles, produced tension points, enabled a distributed model of knowledge, and structured study routines. The pilot round of Learning Circles attracted diverse participants beyond the typical digitally literate MOOC student. Many of them had no previous experience taking online courses and, in some cases, no Internet connection at home. This paper argues that Learning Circles favored the appropriation of artifacts (technologies) and increased participants’ agency as learners in the Internet age. Recommendations for Practitioners: Practitioners can use the Learning Circles model to benefit disenfranchised individuals by providing them with access to materials resources and a network of peers that can help increase their agency as learners. Recommendation for Researchers: This study suggests that it is fundamental to pay attention to learning initiatives that are unfolding outside the scope of traditional and formal education. Impact on Society: Open educational resources and public libraries are opening new pathways for learning beyond traditional higher education institutions. Future Research: Future research can explore how the learning circles are adapted in cultural contexts outside the United States.




co

Printable Table of Contents. JITE: IIP, Volume 22, 2023

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 22, 2023




co

Educational Continuity in Emergencies: The Role of Offline Digital Libraries in Under-Connected Communities

Aim/Purpose: This article explores the critical need for adaptable educational models in times of crisis, focusing on strategies to overcome infrastructural and digital inequalities exacerbated by the COVID-19 pandemic. Background: By examining a case study of an offline digital library project implemented in South Sudan, this paper seeks to examine the impact of an offline digital educational solution for low-resource and crisis situations. Methodology: The authors utilize a mixed-methods approach, integrating both qualitative interviews and quantitative data analysis, to evaluate the use and impact of the SolarSPELL Initiative’s offline digital libraries in South Sudan. Contribution: This study contributes to our understanding of digital and information literacy within crisis contexts, highlighting the vital role of localized, offline content. Findings: The findings demonstrate that offline digital solutions can effectively mitigate educational disruptions by providing an accessible means to continue education during emergencies. Recommendations for Practitioners: Recommendations for practitioners include the adoption of robust offline digital learning solutions to promote educational continuity. Recommendation for Researchers: The authors recommend that researchers continue investigating the potential of offline digital educational solutions for low-resource and crisis situations. Impact on Society: Ultimately, this article finds that offline digital libraries, when paired with skill-building, are a viable means to lessen digital disparities and promote educational continuity in times of crisis and beyond. Future Research: The study suggests further exploration into the long-term impacts of such interventions on learning outcomes.




co

Critical Thinking: The Code to Crack Computer Science Education

Aim/Purpose: This paper explores the potential value of critical thinking in computer science education and discusses strategies for its integration across the curriculum. Background: As technology rapidly evolves and becomes increasingly integrated into society, there is a growing need for computer science graduates who can think critically about the ethical, societal, and technical implications of their work. Methodology: This study employs a conceptual analysis approach, reviewing existing literature on critical thinking in computer science education and synthesising insights from various sources. The analysis focuses on identifying challenges in implementing critical thinking instruction and proposing practical solutions. Contribution: This paper provides an overview of the current discourse on integrating critical thinking into computer science curricula. It explores the distinction between critical thinking and computational thinking, discusses various pedagogical approaches, and offers insights into potential challenges of implementation. Findings: The paper identifies six key challenges in embedding critical thinking into computer science education. It proposes initial steps to address these challenges, including curriculum redesign, innovative assessment methods, and faculty development strategies. Recommendations for Practitioners: Educators should adopt a balanced approach that complements technical education with critical thinking exercises, using diverse teaching methods such as dialogue-based teaching and authentic instruction. Recommendation for Researchers: Future research should focus on empirical studies to assess the effectiveness of the proposed solutions and develop standardised tools for evaluating critical thinking skills in computer science. Impact on Society: By enhancing critical thinking skills in computer science education, we can produce graduates who are better equipped to address complex technological challenges and their societal implications. Future Research: Further investigation is needed into the most effective pedagogical approaches for teaching critical thinking in computer science, with a focus on multidisciplinary perspectives.




co

Generating a Template for an Educational Software Development Methodology for Novice Computing Undergraduates: An Integrative Review

Aim/Purpose: The teaching of appropriate problem-solving techniques to novice learners in undergraduate software development education is often poorly defined when compared to the delivery of programming techniques. Given the global need for qualified designers of information technology, the purpose of this research is to produce a foundational template for an educational software development methodology grounded in the established literature. This template can be used by third-level educators and researchers to develop robust educational methodologies to cultivate structured problem solving and software development habits in their students while systematically teaching the intricacies of software creation. Background: While software development methodologies are a standard approach to structured and traceable problem solving in commercial software development, educational methodologies for inexperienced learners remain a neglected area of research due to their assumption of prior programming knowledge. This research aims to address this deficit by conducting an integrative review to produce a template for such a methodology. Methodology: An integrative review was conducted on the key components of Teaching Software Development Education, Problem Solving, Threshold Concepts, and Computational Thinking. Systematic reviews were conducted on Computational Thinking and Software Development Education by employing the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) process. Narrative reviews were conducted on Problem Solving and Threshold Concepts. Contribution: This research provides a comprehensive analysis of problem solving, software development education, computational thinking, and threshold concepts in computing in the context of undergraduate software development education. It also synthesizes review findings from these four areas and combines them to form a research-based foundational template methodology for use by educators and researchers interested in software development undergraduate education. Findings: This review identifies seven skills and four concepts required by novice learners. The skills include the ability to perform abstraction, data representation, decomposition, evaluation, mental modeling, pattern recognition, and writing algorithms. The concepts include state and sequential flow, non-sequential flow control, modularity, and object interaction. The teaching of these skills and concepts is combined into a spiral learning framework and is joined by four development stages to guide software problem solving: understanding the problem, breaking into tasks, designing, coding, testing, and integrating, and final evaluation and reflection. This produces the principal finding, which is a research-based foundational template for educational software development methodologies. Recommendations for Practitioners: Focusing introductory undergraduate computing courses on a programming syllabus without giving adequate support to problem solving may hinder students in their attainment of development skills. Therefore, providing a structured methodology is necessary as it equips students with essential problem-solving skills and ensures they develop good development practices from the start, which is crucial to ensuring undergraduate success in their studies and beyond. Recommendation for Researchers: The creation of educational software development methodologies with tool support is an under-researched area in undergraduate education. The template produced by this research can serve as a foundational conceptual model for researchers to create concrete tools to better support computing undergraduates. Impact on Society: Improving the educational value and experience of software development undergraduates is crucial for society once they graduate. They drive innovation and economic growth by creating new technologies, improving efficiency in various industries, and solving complex problems. Future Research: Future research should concentrate on using the template produced by this research to create a concrete educational methodology adapted to suit a specific programming paradigm, with an associated learning tool that can be used with first-year computing undergraduates.




co

A Constructionist Approach to Learning Computational Thinking in Mathematics Lessons

Aim/Purpose: This study presents some activities that integrate computational thinking (CT) into mathematics lessons utilizing GeoGebra to promote constructionist learning. Background: CT activities in the Indonesian curriculum are dominated by worked examples with less plugged-mode activities that might hinder students from acquiring CT skills. Therefore, we developed mathematics and CT (math+CT) lessons to promote students’ constructionist key behaviors while learning. Methodology: The researchers utilized an educational design research (EDR) to guide the lesson’s development. The lesson featured 11 applets and 22 short questions developed in GeoGebra. To improve the lesson, it was sent to eight mathematics teachers and an expert in educational technology for feedback, and the lesson was improved accordingly. The improved lessons were then piloted with 17 students, during which the collaborating mathematics teachers taught the lessons. Data were collected through the students’ work on GeoGebra, screen recording when they approached the activities, and interviews. We used content analysis to analyze the qualitative data and presented descriptive statistics to quantitative data. Contribution: This study provided an example and insight into how CT can be enhanced in mathematics lessons in a constructionist manner. Findings: Students were active in learning mathematics and CT, especially when they were engaged in programming and debugging tasks. Recommendations for Practitioners: Educators are recommended to use familiar mathematics software such as GeoGebra to support students’ CT skills while learning mathematics. Additionally, our applets are better run on big-screen devices to optimize students’ CT programming and debugging skills. Moreover, it is recommended that students work collaboratively to benefit from peer feedback and discussion. Recommendation for Researchers: Collaboration with teachers will help researchers better understand the situation in the classroom and how the students will respond to the activities. Additionally, it is important to provide more time for students to get familiar with GeoGebra and start with fewer errors to debug. Future Research: Further research can explore more mathematics topics when integrating CT utilizing GeoGebra or other mathematics software or implement the lessons with a larger classroom size to provide a more generalizable result and deeper understanding.




co

Coding with AI as an Assistant: Can AI Generate Concise Computer Code?

Aim/Purpose: This paper is part of a multi-case study that aims to test whether generative AI makes an effective coding assistant. Particularly, this work evaluates the ability of two AI chatbots (ChatGPT and Bing Chat) to generate concise computer code, considers ethical issues related to generative AI, and offers suggestions for how to improve the technology. Background: Since the release of ChatGPT in 2022, generative artificial intelligence has steadily gained wide use in software development. However, there is conflicting information on the extent to which AI helps developers be more productive in the long term. Also, whether using generated code violates copyright restrictions is a matter of debate. Methodology: ChatGPT and Bing Chat were asked the same question, their responses were recorded, and the percentage of each chatbot’s code that was extraneous was calculated. Also examined were qualitative factors, such as how often the generated code required modifications before it would run. Contribution: This paper adds to the limited body of research on how effective generative AI is at aiding software developers and how to practically address its shortcomings. Findings: Results of AI testing observed that 0.7% of lines and 1.4% of characters in ChatGPT’s responses were extraneous, while 0.7% of lines and 1.1% of characters in Bing Chat’s responses were extraneous. This was well below the 2% threshold, meaning both chatbots can generate concise code. However, code from both chatbots frequently had to be modified before it would work; ChatGPT’s code needed major modifications 30% of the time and minor ones 50% of the time, while Bing Chat’s code needed major modifications 10% of the time and minor ones 70% of the time. Recommendations for Practitioners: Companies building generative AI solutions are encouraged to use this study’s findings to improve their models, specifically by decreasing error rates, adding more training data for programming languages with less public documentation, and implementing a mechanism that checks code for syntactical errors. Developers can use the findings to increase their productivity, learning how to reap generative AI’s full potential while being aware of its limitations. Recommendation for Researchers: Researchers are encouraged to continue where this paper left off, exploring more programming languages and prompting styles than the scope of this study allowed. Impact on Society: As artificial intelligence touches more areas of society than ever, it is crucial to make AI models as accurate and dependable as possible. If practitioners and researchers use the findings of this paper to improve coders’ experience with generative AI, it will make millions of developers more productive, saving their companies money and time. Future Research: The results of this study can be strengthened (or refuted) by a future study with a large, diverse dataset that more fully represents the programming languages and prompting styles developers tend to use. Moreover, further research can examine the reasons generative AI fails to deliver working code, which will yield valuable insights into improving these models.




co

Investigating Factors Contributing to Student Disengagement and Ownership in Learning: A Case Study of Undergraduate Engineering Students

Aim/Purpose: Despite playing a critical role in shaping the future, 70% of undergraduate engineers report low levels of motivation. Student disengagement and a lack of ownership of their learning are significant challenges in higher education, specifically engineering students in the computer science department. This study investigates the various causes of these problems among first-year undergraduate engineers. Background: Student disengagement has become a significant problem, especially in higher education, leading to reduced academic performance, lower graduation rates, and less satisfaction with learning. The study intends to develop approaches that encourage a more interesting and learner-motivated educational environment. Methodology: This research uses a mixed methods approach by combining quantitative data from a survey-based questionnaire with qualitative insights from focus groups to explore intrinsic and extrinsic motivators, instructional practices, and student perceptions of relevance and application of course content. The aim of this method is to make an all-inclusive exploration into undergraduate engineering students’ perspectives on factors contributing to this disengagement and the need for more ownership. Contribution: Inculcating passion for engineering among learners seems demanding, with numerous educational programs struggling with issues such as a lack of interest by students and no personal investment in learning. Understanding the causes is of paramount importance. The study gives suggestions to help teachers or institutions create a more engaged and ownership-based learning environment for engineering students. Findings: The findings revealed a tangled web influencing monotonous teaching styles, limited opportunities and applications, and a perceived gap between theoretical knowledge and real-world engineering problems. It emphasized the need to implement more active learning strategies that could increase autonomy and a stronger sense of purpose in their learning journey. It also highlights the potential use of technology in promoting student engagement and ownership. Further research is needed to explore optimal implementation strategies for online simulations, interactive learning platforms, and gamification elements in the engineering curriculum. Recommendations for Practitioners: It highlights the complex interplay of intrinsic and extrinsic motivation factors and the need to re-look at instructional practice and emphasize faculty training to develop a more student-centered approach. It also stresses the need to look into the relevance and application of the course content. Recommendation for Researchers: More work needs to be done with a larger, more diverse sample population across multiple institutions and varied sociocultural and economic backgrounds. Impact on Society: Enhancing learners’ educational experience can result in creating a passionate and competent team of engineers who can face future obstacles fearlessly and reduce the production of half-baked graduates unprepared for the profession’s challenges. Future Research: Conduct long-term studies to assess the impact of active learning and technology use on student outcomes and career readiness. Investigate scaling up successful strategies across diverse engineering programs. See if promising practices work well everywhere.




co

Impact of a Digital Tool to Improve Metacognitive Strategies for Self-Regulation During Text Reading in Online Teacher Education

Aim/Purpose: The aim of the study is to test whether the perception of self-regulated learning during text reading in online teacher education is improved by using a digital tool for the use of metacognitive strategies for planning, monitoring, and self-assessment. Background: The use of self-regulated learning is important in reading skills, and for students to develop self-regulated learning, their teachers must master it. Therefore, teaching strategies for self-regulated learning in teacher education is essential. Methodology: The sample size was 252 participants with the tool used by 42% or the participants. A quasi-experimental design was used in a pre-post study. ARATEX-R, a text-based scale, was used to evaluate self-regulated learning. The 5-point Likert scale includes the evaluation of five dimensions: planning strategies, cognition management, motivation management, comprehension assessment and context management. A Generalized Linear Model was used to analyse the results. Contribution: Using the tool to self-regulate learning has led to an improvement during text reading, especially in the dimensions of motivation management, planning management and comprehension assessment, key dimensions for text comprehension and learning. Findings: Participants who use the app perceive greater improvement, especially in the dimensions of motivation management (22,3%), planning management (19.9%) and comprehension assessment (24,6%), which are fundamental dimensions for self-regulation in text reading. Recommendations for Practitioners: This tool should be included in teacher training to enable reflection during the reading of texts, because it helps to improve three key types of strategies in self-regulation: (1) planning through planning management, (2) monitoring through motivation management and comprehension assessment, and (3) self-assessment through comprehension assessment. Recommendation for Researchers: The success of the tool suggests further study for its application in other use cases: other student profiles in higher education, other teaching modalities, and other educational stages. These studies will help to identify adaptations that will extend the tool’s use in education. Impact on Society: The use of Metadig facilitates reflection during the reading of texts in order to improve comprehension and thus self-regulate the learning of content. This reflection is crucial for students’ knowledge construction. Future Research: Future research will focus on enhancing the digital tool by adding features to support the development of cognition and context management. It will also focus on how on adapting the tool to help other types of learners.




co

The Utilization of 3D Printers by Elementary-Aged Learners: A Scoping Review

Aim/Purpose: This review’s main objective was to examine the existing literature on the use of 3D printers in primary education, covering students aged six to twelve across general, special, and inclusive educational environments. Background: A review of the literature indicated a significant oversight – prior reviews insufficiently distinguish the application of 3D printing in primary education from its utilization at higher educational tiers or focused on particular subject areas and learning domains. Considering the distinct nature and critical role of primary education in developing young students’ cognitive abilities and skills, it is essential to concentrate on this specific educational stage. Methodology: The scoping review was selected as the preferred research method. The methodological robustness was augmented through the utilization of the backward snowballing technique. Consequently, a total of 50 papers were identified and subjected to thorough analysis. Contribution: This review has methodically compiled and analyzed the literature on 3D printing use among elementary students, offering a substantial addition to academic conversations. It consolidated and organized research on 3D printers’ educational uses, applying robust and credible criteria. Findings: Many studies featured small sample sizes and limited research on inclusive and special education. The analysis revealed 82 distinct research goals and 13 educational fields, with STEM being the predominant focus. Scholars showed considerable interest in how 3D printers influence skills like creativity and problem-solving, as well as emotions such as engagement and motivation. The majority of studies indicated positive outcomes, enhancing academic achievement, engagement, collaboration, creativity, interest, and motivation. Nonetheless, challenges were noted, highlighting the necessity for teacher training, the expense of equipment, technical difficulties, and the complexities of blending new methods with traditional curricula. Recommendations for Practitioners: To capitalize on the benefits that 3D printers bring, curriculum planners are urged to weave them into their programs, ensuring alignment with educational standards and skill development. The critical role educators play in the effective implementation of this technology necessitates targeted professional development programs to equip them with the expertise for successful integration. Moreover, 3D printing presents a unique opportunity to advance inclusive education for students with disabilities, offering tailored learning experiences and aiding in creating assistive technologies. In recognizing the disparities in access to 3D printing, educational leaders must address the financial and logistical barriers highlighted in the literature. Strategic initiatives are essential to democratize 3D printing access, ensuring all students benefit from this educational tool. Recommendation for Researchers: Comparative studies are critical to elucidate the specific advantages and limitations of 3D printing technology due to the scarcity of research contrasting it with other tools. The variability in reporting durations of interventions and research environments underscores the necessity for uniform methodologies and benchmarks. Because research has predominantly focused on STEM/STEAM education, expanding into different educational areas could provide a comprehensive understanding of 3D printing’s capabilities. The existence of neutral and negative findings signals an opportunity for further investigation. Exploring the factors that impede the successful integration of 3D printing will inform the creation of superior pedagogical approaches and technological refinements. Future Research: As the review confirmed the significant promise of 3D printing technology in enriching education, especially in the context of primary education, the imperative for continued research to refine its application in primary education settings is highlighted.




co

AI Chatbot Adoption in Academia: Task Fit, Usefulness and Collegial Ties

Aim/Purpose: This mixed-methods study aims to examine factors influencing academicians’ intentions to continue using AI-based chatbots by integrating the Task-Technology Fit (TTF) model and social network characteristics. Background: AI-powered chatbots are gaining popularity across industries, including academia. However, empirical research on academicians’ adoption behavior is limited. This study proposes an integrated model incorporating TTF factors and social network characteristics like density, homophily, and connectedness to understand academics’ continuance intentions. Methodology: A qualitative study involving 31 interviews of academics from India examined attitudes and the potential role of social network characteristics like density, homophily, and connectedness in adoption. Results showed positive sentiment towards chatbots and themes on how peer groups accelerate diffusion. In the second phase, a survey of 448 faculty members from prominent Indian universities was conducted to test the proposed research model. Contribution: The study proposes and validates an integrated model of TTF and social network factors that influence academics’ continued usage intentions toward AI chatbots. It highlights the nuanced role of peer networks in shaping adoption. Findings: Task and technology characteristics positively affected academics’ intentions to continue AI chatbot usage. Among network factors, density showed the strongest effect on TTF and perceived usefulness, while homophily and connectedness had partial effects. The study provides insights into designing appropriate AI tools for the academic context. Recommendations for Practitioners: AI chatbot designers should focus on aligning features to academics’ task needs and preferences. Compatibility with academic work culture is critical. Given peer network influences, training and demonstrations to user groups can enhance adoption. Platforms should have capabilities for collaborative use. Targeted messaging customized to disciplines can resonate better with academic subgroups. Multidisciplinary influencers should be engaged. Concerns like plagiarism risks, privacy, and job impacts should be transparently addressed. Recommendation for Researchers: More studies are needed across academic subfields to understand nuanced requirements and barriers. Further studies are recommended to investigate differences across disciplines and demographics, relative effects of specific network factors like size, proximity, and frequency of interaction, the role of academic leadership and institutional policies in enabling chatbot adoption, and how AI training biases impact usefulness perceptions and ethical issues. Impact on Society: Increased productivity in academia through the appropriate and ethical use of AI can enhance quality, access, and equity in education. AI can assist in mundane tasks, freeing academics’ time for higher-order objectives like critical thinking development. Responsible AI design and policies considering socio-cultural aspects will benefit sustainable growth. With careful implementation, it can make positive impacts on student engagement, learning support, and research efficiency. Future Research: Conduct longitudinal studies to examine the long-term impacts of AI chatbot usage in academia. Track usage behaviors over time as familiarity develops. Investigate differences across academic disciplines and roles. Requirements may vary for humanities versus STEM faculty or undergraduate versus graduate students. Assess user trust in AI and how it evolves with repeated usage, and examine trust-building strategies. Develop frameworks to assess pedagogical effectiveness and ethical risks of conversational agents in academic contexts.