The use of blended learning is well suited for classes that involve a high level of experiential inquiry such as internship courses. These courses allow students to combine applied, face-to-face fieldwork activities with a reflective academic component delivered online. Therefore, the purpose of this article is to describe the pedagogical design and implementation of a pilot blended learning format internship course. After implementation, the pilot class was assessed. Results of the survey and focus group revealed high levels of student satisfaction in the areas of course structure, faculty-student interaction, and application of theory to the “real-world” experience undertaken by students during the internship. Lower levels of satisfaction with the course’s academic rigor and a sense of community were also reported. Notably, students with experience in blended learning expressed lower levels of overall satisfaction, but reported higher levels of satisfaction with the course’s rigor and sense of community. The paper concludes by offering implications for instructors seeking to implement blended learning approaches.

Teaching advanced programming can be a challenge, especially when the students are pursuing different majors with diverse analytical and problem-solving capabilities. The purpose of this paper is to explore the efficacy of using a particular problem as a vehicle for imparting a broad set of programming concepts and problem-solving techniques. We present a classic brain teaser that is used to communicate and demonstrate advanced software development concepts and techniques. Our results show that students with varied academic experiences and goals, assuming at least one procedural/structured programming pre-requisite, can benefit from and also be challenged by such an exercise. Although this problem has been used by others in the classroom, we believe that our use of this problem in imparting such a broad range of topics to a diverse student population is unique.

As mobile devices become prevalent, there is always a need for apps.  How hard is it to develop an app especially a cross-platform app? The paper shares an experience in a project involved the development of a student services web app that can be run on cross-platform mobile devices.  The paper first describes the background of the project, the clients, and the proposed solution.  Then, it focuses on the step-by-step development processes and provides the illustration of written codes and techniques used.  The goal is for readers to gain an understanding on how to develop a mobile-friendly web app.  The paper concludes with teaching implications and offers thoughts for further development.  

This research study explores peer teaching and learning without a domain expert teacher, within the context of an activity where teams of second level students (~16 years old) are required to create a learning experience for their peers. The study looks at how participants would like to be taught and how they would teach their peers if given the opportunity and examines the support they require, their motivation levels, and if they actually learn curriculum content using this approach. An exploratory case study methodology was used, and the findings suggest that students want varied learning experiences that include many of the elements which would fall under the heading of 21st century learning, that with some support and encouragement they can create innovative learning experiences for their peers, and that they can learn curriculum content from the process.

The ways people connect, interact, share, and communicate have changed due to recent developments in information technology. These developments, categorized as social media, have captured the attention of business executives, technologists, and education professionals alike, and have altered many business models. Additionally, the concept of social media impacts numerous sub-disciplines within business and has become an important issue with operational, tactical, and strategic considerations. Despite this interest, many business schools do not have courses involving social media technologies and applications. In those that do, the placement and focus of the course varies considerably. This article provides motivation and insight into the process of developing an approach for effectively teaching social media use in business. Additionally, it offers implementation examples of courses taught at three major universities. The article concludes with lessons-learned that will give instructors practical guidance and ensure that social media courses taught in a business school provide students with a solid basis for integrating social media into business practice.

Electronic portfolios (e-portfolios) have a positive impact on the learning process in a broad range of educational sectors and on learners of all ages. Yet because most e-portfolio-related studies are about their implementation in higher education, this type of research is less usual in the early childhood context, and there is no available research for Greek schools. This study aims to investigate the impact of e-portfolios on learning in a Greek primary school and to provide a resource regarding the educational benefits of e-portfolio in primary education. To do that, it employs the qualitative naturalistic method to collect data, along with mixed methods which were used to achieve triangulation and strengthen confidence in the outcomes. Participants in the research were fourteen 8-year-old pupils, and one of the researchers was their regular teacher. Data evaluation revealed that the e-portfolio added value in pupils’ learning, acted as a medium to involve parents, promoted pupils’ self-esteem, and was acknowledged as a valuable assessment tool and a challenge for the school community. Based on the experience of the e-portfolio implementation, the authors provide some suggestions that would possibly help researchers and primary school teachers adopt and develop e-portfolio systems in their particular settings.

Pair programming is a collaborative programming practice that places participants in dyads, working in tandem at one computer to complete programming assignments. Pair programming studies with Computer Science (CS) and Software Engineering (SE) majors have identified benefits such as technical productivity, program/design quality, academic performance, and increased satisfaction for their participants. In this paper, pair programming is studied with Management Information Systems (MIS) majors, who (unlike CS and SE majors taking several programming courses) typically take only one programming course and often struggle to develop advanced programming skills within that single course. The researchers conducted two pair programming experiments in an introductory software development course for MIS majors over three semesters to determine if pair programming could enhance learning for MIS students. The program results, researchers’ direct observations, and participants’ responses to a survey questionnaire were analyzed after each experiment. The results indicate that pair programming appears to be beneficial to MIS students’ technical productivity and program design quality, specifically the ability to create programs using high-level concepts. Additionally, results confirmed increased student satisfaction and reduced frustration, as the pairs worked collaboratively to produce a program while actively communicating and enjoying the process.

The nexus between paid work and study is important. Developing opportunities to facilitate this link is a key part of good course design especially in postgraduate programs. Strong communities of practice can also assist with improving links between research and practice. The online study environment affords some challenges to achieving these goals. The current study proposes that offering formalised interaction points— synchronous or asynchronous— during online study, is critical to facilitating the link between work and study. Twenty-five graduates of a postgraduate program were interviewed to explore their experiences of an online program of study. Three key themes emerged and are described in this paper: engaging with study, building a new framework for my practice, and implementing changes to my practice. Online learning programs need to embed opportunities for interaction that are meaningful and allow for development of ideas and discussion, aiming to take learning beyond the program of study.

Prior work demonstrates the importance of introducing young children to programming and engineering content before gender stereotypes are fully developed and ingrained in later years. However, very little research on gender and early childhood technology interventions exist. This pilot study looks at N=45 children in kindergarten through second grade who completed an eight-week robotics and programming curriculum using the KIWI robotics kit. KIWI is a developmentally appropriate robotics construction set specifically designed for use with children ages 4 to 7 years old. Qualitative pre-interviews were administered to determine whether participating children had any gender-biased attitudes toward robotics and other engineering tools prior to using KIWI in their classrooms. Post-tests were administered upon completion of the curriculum to determine if any gender differences in achievement were present. Results showed that young children were beginning to form opinions about which technologies and tools would be better suited for boys and girls. While there were no significant differences between boys and girls on the robotics and simple programming tasks, boys performed significantly better than girls on the advanced programming tasks such as, using repeat loops with sensor parameters. Implications for the design of new technological tools and curriculum that are appealing to boys and girls are discussed.

Since the advent of the iPhone and rise of mobile technologies, educational apps represent one of the fastest growing markets, and both the mobile technology and educational app markets are predicted to continue experiencing growth into the foreseeable future. The irony, however, is that even with a booming market for educational apps, very little research regarding the quality of them has been conducted. Though some instruments have been developed to evaluate apps geared towards student learning, no such instrument has been created for teacher resource apps, which are designed to assist teachers in completing common tasks (e.g., taking attendance, communicating with parents, monitoring student learning and behavior, etc.). Moreover, when teachers visit the App Store or Google Play to learn about apps, the only ratings provided to them are generic, five-point evaluations, which do not provide qualifiers that explain why an app earned three, two, or five points. To address that gap, previously conducted research related to designing instructional technologies coupled with best practices for supporting teachers were first identified. That information was then used to construct a comprehensive rubric for assessing teacher re-source apps. In this article, a discussion that explains the need for such a rubric is offered before describing the process used to create it. The article then presents the rubric and discusses its different components and potential limitations and concludes with suggestions for future research based on the rubric.

Immigrant students face a multitude of problems, among which are poor social adaptation and school integration. On the other hand, although digital narrations are widely used in education, they are rarely used for aiding students or for the resolution of complex problems. This study exploits the potential of digital narrations towards this end, by examining how the development and presentation of an autobiographical digital narration can assist immigrant students in overcoming their adaptation difficulties. For that matter, a female student presenting substantial problems was selected as the study’s subject. Data was collected from all the participating parties (subject, teacher, classmates) using a variety of tools, before, during, and after the intervention. It was found that through the digital narration she was able to externalize her thoughts and feelings and this, in turn, helped her in achieving a smoother integration in the school environment. In addition, the attitudes and perceptions of the other students for their foreign classmate were positively influenced. The intervention was short in duration and it did not require special settings. Hence, it can be easily applied and educators can consider using similar interventions. On the other hand, further research is recommended to establish the generalizability of the study’s findings.

Mobile devices are the constant companions of technology users of all ages. Studies show, however, that making calls is a minimal part of our engagement with today’s smart phones and that even texting has fallen off, leaving web browsing, gaming, and social media as top uses. A cross-disciplinary group of faculty at our university came together in the mLearning Scholars group to study the potential for using mobile devices for student learning. The group met bi-weekly throughout a semester and shared thoughts, ideas, resources, and examples, while experimenting with mobile learning activities in individual classes. This paper summarizes student perceptions and adoption intent for using mobile devices for learning, and discusses implementation issues for faculty in adding mobile learning to a college course. Outcomes reflect that mobile learning adoption is not a given, and students need help in using and understanding the value in using personal devices for learning activities.

Aim/Purpose: To examine the early perceptions (acceptability) and usability of EASEL (Education through Application-Supported Experiential Learning), a mobile platform that delivers reflection prompts and content before, during, and after an experiential learning activity. Background: Experiential learning is an active learning approach in which students learn by doing and by reflecting on the experience. This approach to teaching is often used in disciplines such as humanities, business, and medicine. Reflection before, during, and after an experience allows the student to analyze what they learn and why it is important, which is vital in helping them to understand the relevance of the experience. A just-in-time tool (EASEL) was needed to facilitate this. Methodology: To inform the development of a mobile application that facilitates real-time guided reflection and to determine the relevant feature set, we conducted a needs analysis with both students and faculty members. Data collected during this stage of the evaluation helped guide the creation of a prototype. The user experience of the prototype and interface interactions were evaluated during the usability phase of the evaluation study. Contribution: Both the needs analysis and usability assessment provided justification for continued development of EASEL as well as insight that guides current development. Findings: The interaction design of EASEL is understandable and usable. Both students and teachers value an application that facilitates real-time guided reflection. Recommendations for Practitioners: The use of a system such as EASEL can leverage time and location-based services to support students in field experiences. This technology aligns with evidence that guided reflection provides opportunities for metacognition. Recommendation for Researchers: Iterative prototyping, testing, and refinement can lead to a deliberate and effective app development process. Impact on Society: The EASEL platform leverages inherent functionality of mobile devices, such as GPS and persistent network connectivity, to adapt reflection tasks based on lo-cation or time. Students using EASEL will engage in guided reflection, which leads to metacognition and can help instructors scaffold learning Future Research: We will continue to advance the application through iterative testing and development. When ready, the application will be vetted in larger studies across varied disciplines and contexts.

Aim/Purpose: The present study investigated and compared students’ attention in terms of time-on-task and number of distractors between using a touchscreen and a pen tablet in mathematical problem-solving activities with virtual manipulatives. Background: Although there is an increasing use of these input devices in educational practice, little research has focused on assessing student attention while using touchscreens or pen tablets in a mathematics classroom. Methodology: A qualitative exploration was conducted in a public elementary school in New Taipei, Taiwan. Six fifth-grade students participated in the activities. Video recordings of the activities and the students’ actions were analyzed. Findings: The results showed that students in the activity using touchscreens maintained greater attention and, thus, had more time-on-task and fewer distractors than those in the activity using pen tablets. Recommendations for Practitioners: School teachers could employ touchscreens in mathematics classrooms to support activities that focus on students’ manipulations in relation to the attention paid to the learning content. Recommendation for Researchers: The findings enhance our understanding of the input devices used in educational practice and provide a basis for further research. Impact on Society: The findings may also shed light on the human-technology interaction process involved in using pen and touch technology conditions. Future Research: Activities similar to those reported here should be conducted using more participants. In addition, it is important to understand how students with different levels of mathematics achievement use the devices in the activities.

Aim/Purpose: To prepare students with both theoretical knowledge and practical skills in the field of wireless communications. Background: Teaching wireless communications and networking is not an easy task because it involves broad subjects and abstract content. Methodology: A pedagogical method that combined lectures, labs, assignments, exams, and readings was applied in a course of wireless communications. Contribution: Five wireless networking labs, related to wireless local networks, wireless security, and wireless sensor networks, were developed for students to complete all of the required hands-on lab activities. Findings: Both development and implementation of the labs achieved a successful outcome and provided students with a very effective learning experience. Students expressed that they had a better understanding of different wireless network technologies after finishing the labs. Recommendations for Practitioners: Detailed instructional lab manuals should be developed so that students can carry out hands-on activities in a step-by-step fashion. Recommendation for Researchers: Hands-on lab exercises can not only help students understand the abstract technical terms in a meaningful way, but also provide them with hands-on learning experience in terms of wireless network configuration, implementation, and evaluation. Impact on Society: With the help of a wireless network simulator, students have successfully enhanced their practical skills and it would benefit them should they decide to pursue a career in wireless network design or implementation. Future Research: Continuous revision of the labs will be made according to the feedback from students. Based on the experience, more wireless networking labs and network issues could be studied in the future.

Aim/Purpose: As smartphones proliferate, many different platforms begin to emerge. The challenge to developers as well as IS educators and students is how to learn the skills to design and develop apps to run on cross-platforms. Background: For developers, the purpose of this paper is to describe an alternative to the complex native app development. For IS educators and students, the paper provides a feasible way to learn and develop fully functional mobile apps without technical burdens. Methodology: The methods used in the development of browser-based apps is prototyping. Our proposed approach is browser-based, supports cross-platforms, uses open-source standards, and takes advantage of “write-once-and-run-anywhere” (WORA) concept. Contribution: The paper illustrates the application of the browser-based approach to create a series of browser apps without high learning curve. Findings: The results show the potentials for using browser app approach to teach as well as to create new apps. Recommendations for Practitioners : Our proposed browser app development approach and example would be useful to mobile app developers/IS educators and non-technical students because the source code as well as documentations in this project are available for downloading. Future Research: For further work, we discuss the use of hybrid development framework to enhance browser apps.

Aim/Purpose: This paper provides a review of previously published work related to active learning in information systems (IS) courses. Background: There are a rising number of strategies in higher education that offer promise in regards to getting students’ attention and helping them learn, such as flipped classrooms and offering courses online. These learning strategies are part of the pedagogical technique known as active learning. Active learning is a strategy that became popular in the early 1990s and has proven itself as a valid tool for helping students to be engaged with learning. Methodology: This work follows a systematic method for identifying and coding previous research based on an aspect of interest. The authors identified and assessed research through a search of ABI/Inform scholarly journal abstracts and keywords, as well as additional research databases, using the search terms “active learning” and “information systems” from 2000 through June 2016. Contribution: This synthesis of active learning exercises provides guidance for information technology faculty looking to implement active learning strategies in their classroom by demonstrating how IS faculty might begin to introduce more active learning techniques in their teaching as well as by presenting a sample teaching agenda for a class that uses a mix of active and passive learning techniques to engage student learning. Findings: Twenty successful types of active learning exercises in IS courses are presented. Recommendations for Practitioners : This paper offers a “how to” resource of successful active learning strategies for IS faculty interested in implementing active learning in the classroom. Recommendation for Researchers: This work provides an example of a systematic literature review as a means to assess successful implementations of active learning in IS. Impact on Society: An updated definition of active learning is presented as well as a meaningful list of exercises that encourage active learning both inside and outside of the IS classroom. Future Research: In relation to future research, this study highlights a number of opportunities for IS faculty in regards to new active learning activities or trends to study further.

Aim/Purpose: To identify positive and negative aspects for learning of interactive tablet technology learning activities that promote student engagement and learning. Background: Engaging students in mathematics classes is an on-going challenge for teachers. In 2008 we were offered the opportunity to run interactive activities with a class set of tablet PCs that had just been released on to the market. Since then, we have run these interactive activities continuously with mathematics classes for computing students, albeit with two changes in hardware. Methodology: In the interactive activities, students submit full worked solutions to various problem types (classified as table, text, open or multi-choice) which can then be displayed to the class anonymously, discussed and annotated by the teacher. We surveyed student and staff perceptions and monitored academic performance. Contribution: We have over 10 years of results, observations, and experience from 2008, when tablet technologies were new and expensive, to the current time, when modern tablets with styli are now affordable. Findings: There was a significant increase in higher grades although pass rates did not increase significantly. Over the ten year period of the study, perceptions of students and staff about how this technology impacted on student learning were consistently positive. The majority of students found all problem types useful for learning even those they rated “too hard” or “too easy”. Benefits included increased feedback, peer learning and engagement. Recommendations for Practitioners: We recommend using tablet learning activities to engage students and teachers and to contribute to learning. Impact on Society: This study shows how using tablet technologies for interactive classroom activities can enable and enhance known pedagogies of feedback, peer instruction, and student engagement for mathematics classes. Future Research: We recommend extending this study to include larger classes, and other technical subjects that use symbols and diagrams. In addition, we suggest considering control groups.

Aim/Purpose: The aims of this study were to investigate the feasibility of automatic assessment of programming tasks and to compare manual assessment with automatic assessment in terms of the effect of the different assessment methods on the marks of the students. Background: Manual assessment of programs written by students can be tedious. The assistance of automatic assessment methods might possibly assist in reducing the assessment burden, but there may be drawbacks diminishing the benefits of applying automatic assessment. The paper reports on the experience of a lecturer trying to introduce automated grading. Students’ solutions to a practical Java programming test were assessed both manually and automatically and the lecturer tied the experience to the unified theory of acceptance and use of technology (UTAUT). Methodology: The participants were 226 first-year students registered for a Java programming course. Of the tests the participants submitted, 214 were assessed both manually and automatically. Various statistical methods were used to compare the manual assessment of student’s solutions with the automatic assessment of the same solutions. A detailed investigation of reasons for differences was also carried out. A further data collection method was the lecturer’s reflection on the feasibility of automatic assessment of programming tasks based on the UTAUT. Contribution: This study enhances the knowledge regarding benefits and drawbacks of automatic assessment of students’ programming tasks. The research contributes to the UTAUT by applying it in a context where it has hardly been used. Furthermore, the study is a confirmation of previous work stating that automatic assessment may be less reliable for students with lower marks, but more trustworthy for the high achieving students. Findings: An automatic assessment tool verifying functional correctness might be feasible for assessment of programs written during practical lab sessions but could be less useful for practical tests and exams where functional, conceptual and structural correctness should be evaluated. In addition, the researchers found that automatic assessment seemed to be more suitable for assessing high achieving students. Recommendations for Practitioners: This paper makes it clear that lecturers should know what assessment goals they want to achieve. The appropriate method of assessment should be chosen wisely. In addition, practitioners should be aware of the drawbacks of automatic assessment before choosing it. Recommendation for Researchers: This work serves as an example of how researchers can apply the UTAUT theory when conducting qualitative research in different contexts. Impact on Society: The study would be of interest to lecturers considering automated assessment. The two assessments used in the study are typical of the way grading takes place in practice and may help lecturers understand what could happen if they switch from manual to automatic assessment. Future Research: Investigate the feasibility of automatic assessment of students’ programming tasks in a practical lab environment while accounting for structural, functional and conceptual assessment goals.

Aim/Purpose: This study was aimed at enhancing students’ learning of software engineering methods. A collaboration between the Computer Science, Business Management, and Product Design programs was formed to work on actual projects with real clients. This interdisciplinary form of collaboration simulates the realities of a diverse Software Engineering team. Background: A collaborative approach implemented through projects has been the established pedagogy for introducing the Software Engineering course to undergraduate Computer Science students. The collaboration, however, is limited to collaboration among Computer Science students and their clients. This case study explored an enhancement to the collaborative approach to project development by integrating other related disciplines into the project development framework; hence, the Interdisciplinary Approach. Methodology: This study adopted the case method approach. An interdisciplinary service innovation activity was proposed to invite other disciplines in the learning process of the computer science students. The agile methodology Scrum was used as the software development approach during project development. Survey data were collected from the students to establish (a) their perception of the interdisciplinary approach to project development; (b) the factors that influenced success or failure of their team to deliver the project; and (c) the perceived skills or knowledge that they acquired from the interdisciplinary approach. Analysis of data followed a mixed method approach. Contribution: The study improved the current pedagogy for Software Engineering education by integrating other related disciplines into the software project development framework. Findings: Data collected showed that the students generally accepted the interdisciplinary approach to project development. Factors such as project relevance, teamwork, time and schedule, and administration support, among others, affect team performance towards project completion. In the case of the Computer Science students, results show that students have learned skills during the experience that, as literature reveal, can only be acquired or mastered in their future profession as software engineers. Recommendations for Practitioners: The active collaboration of the industry with the University and the involvement of the other related courses in teaching software engineering methods are critical to the development of the students, not only in learning the methodology but also as a working professional. Recommendation for Researchers: It is interesting to know and eventually understand the interactions between interdisciplinary team members in the conduct of Software Engineering practices while working on their projects. More specifically, what creative tensions arise and how do the interdisciplinary teams handle the discourse? Impact on Society: This study bridges the gap between how Software Engineering is taught in the university and how Software Engineering teams work in real life. Future Research: Future research is targeted at refining and elaborating the elements of the interdisciplinary framework presented in this paper towards an integrated course module for Software Engineering education.

Aim/Purpose: The dynamic nature of the information systems (IS) field presents educators with the perpetual challenge of keeping course offerings current and relevant. This paper describes the process at a College of Business (COB) to redesign the introductory IS course to better prepare students for advanced business classes and equip them with interdisciplinary knowledge and skills demanded in today’s workplace. Background: The course was previously in the Computer Science (CSC) Department, itself within the COB. However, an administrative restructuring resulted in the CSC department’s removal from the COB and left the core course in limbo. Methodology: This paper presents a case study using focus groups with students, faculty, and advisory council members to assess the value of the traditional introductory course. A survey was distributed to students after implementation of the newly developed course to assess the reception of the course. Contribution: This paper provides an outline of the decision-making process leading to the course redesign of the introductory IS course, including the context and the process of a new course development. Practical suggestions for implementing and teaching an introductory IS course in a business school are given. Findings: Focus group assessment revealed that stakeholders rated the existing introductory IS course of minimal value as students progressed through the COB program, and even less upon entering the workforce. The findings indicated a complete overhaul of the course was required. Recommendations for Practitioners: The subject of technology sometimes requires more than a simple update to the curriculum. When signs point to the need for a complete overhaul, this paper gives practical guidance supplemented with relevant literature for other academicians to follow. Recommendation for Researchers: Students are faced with increasing pressure to be proficient with the latest technology, in both the classroom where educators are trying to prepare them for the modern workplace, as well as the organization which faces an even greater pressure to leverage the latest technology. The newly designed introductory IS course provides students, and eventually organizations, a better measure of this proficiency. Future Research: Future research on the efficacy of this new course design should include longitudinal data to determine the impact on graduates, and eventually the assessment of those graduates’ performance in the workplace.

Aim/Purpose: Bioengineering is a burgeoning interdisciplinary learning domain that could inspire the imaginations of elementary aged children but is not traditionally taught to this age group for reasons unrelated to student ability. This pilot study presents the BacToMars videogame and accompanying curricular intervention, designed to introduce children (aged 7-11) to foundational concepts of bioengineering and to the interdisciplinary nature of scientific endeavors. Background: This pilot study explores the bioengineering-related learning outcomes and attitudes of children after engaging with the BacToMars game and curriculum intervention. Methodology: This study drew on prior findings in game-based learning and applied them to a videogame designed to connect microbiology with Constructionist microworlds. An experimental comparison showed the learning and engagement affordances of integrating this videogame into a mixed-media bioengineering curriculum. Elementary-aged children (N = 17) participated in a 9-hour learning intervention, with one group of n = 8 children receiving the BacToMars videogame and the other group (n = 9) receiving traditional learning activities on the same content. Pre- and post-surveys and interview data were collected from both groups. Contribution: This paper contributes to education research on children’s ability to meaningfully engage with abstract concepts at the intersection of science and engineering through bioengineering education, and to design research on developing educational technology for introducing bioengineering content to elementary school children. Findings: Children in both groups showed improved knowledge and attitudes related to bioengineering. Children who used BacToMars showed slightly stronger performance on game-specific concepts, while children in the control condition showed slightly higher generalized knowledge of bioengineering concepts. Recommendations for Practitioners: Practitioners should consider bioengineering as a domain for meaningful, interdisciplinary learning in elementary education.. Recommendation for Researchers: Design researchers should develop playful ways to introduce bioengineering concepts accurately and to engage children’s imaginations and problem-solving skills. Education researchers should further investigate developmentally appropriate ways to introduce bioengineering in elementary education. Impact on Society: BacToMars introduces a meaningful scenario to contextualize complex con-cepts at the intersection of science and engineering, and to engage children in real-world, interdisciplinary problem solving. Future Research: Future research should explore BacToMars and bioengineering curricula for elementary-aged children in larger samples, with longer intervention times.

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of policy driven and plagiarism detection approaches. These mechanisms are either proactive or reactive and focus on identifying, catching, and punishing those found to have cheated or plagiarized. To be more effective against plagiarism, mechanisms that detect cheating or colluding in real-time are desirable. Methodology: In the development of a tool for real-time plagiarism prevention, literature review and prototyping was used. The prototype was implemented in Delphi programming language using Indy components. Contribution: A real-time plagiarism detection tool suitable for use in a computer-based assessment setting is developed. This tool can be used to complement other existing mechanisms. Findings: The developed tool was tested in an environment with 55 personal computers and found to be effective in detecting unauthorized access to internet, intranet, and USB ports on the personal computers. Recommendations for Practitioners: The developed tool is suitable for use in any environment where computer-based evaluation may be conducted. Recommendation for Researchers: This work provides a set of criteria for developing a real-time plagiarism prevention tool for use in a computer-based assessment. Impact on Society: The developed tool prevents academic dishonesty during an assessment process, consequently, inculcating confidence in the assessment processes and respectability of the education system in the society. Future Research: As future work, we propose a comparison between our tool and other such tools for its performance and its features. In addition, we want to extend our work to include testing for scalability of the tool to larger settings.

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 17, 2018

Aim/Purpose: This research aims to describe and demonstrate the results of an intervention through educational robotics to improve the computational thinking of student teachers. Background: Educational robotics has been increasing in school classrooms for the development of computational thinking and digital competence. However, there is a lack of research on how to prepare future teachers of Kindergarten and Elementary School in the didactic use of computational thinking, as part of their necessary digital teaching competence. Methodology: Following the Design-Based Research methodology, we designed an intervention with educational robots that includes unplugged, playing, making and remixing activities. Participating in this study were 114 Spanish university students of education. Contribution: This research helps to improve the initial training of student teachers, especially in the field of educational robotics. Findings: The student teachers consider themselves digital competent, especially in the dimensions related to social and multimedia aspects, and to a lesser extent in the technological dimension. The results obtained also confirm the effectiveness of the intervention through educational robotics in the development of computational thinking of these students, especially among male students. Recommendations for Practitioners: Teacher trainers could introduce robotics following these steps: (1) initiation and unplugged activities, (2) gamified activities of initiation to the programming and test of the robots, (3) initiation activities to Scratch, and (4) design and resolution of a challenge. Recommendation for Researchers: Researchers could examine how interventions with educational robots helps to improve the computational thinking of student teachers, and thoroughly analyze gender-differences. Impact on Society: Computational thinking and robotics are one of the emerging educational trends. Despite the rise of this issue, there are still few investigations that systematize and collect evidence in this regard. This study allows to visualize an educational intervention that favors the development of the computational thinking of student teachers. Future Research: Researchers could evaluate not only the computational thinking of student teachers, but also their didactics, their ability to teach or create didactic activities to develop computational thinking in their future students.

Aim/Purpose: The main aim of this study was modeling a collaborative process for knowledge visualization, via the creation of infographics. Background: As an effective method for visualizing complex information, creating infographics requires learners to generate and cultivate a deep knowledge of content and enables them to concisely visualize and share this knowledge. This study investigates creating infographics as a knowledge visualization process for collaborative learning situations by integrating the infographic design model into the team-based and technology-mediated Bridge21 learning model. Methodology: This study was carried out using an educational design perspective by conducting three main cycles comprised of three micro cycles: analysis and exploration; design and construction; evaluation and reflection. The process and the scaffolding were developed and enhanced from cycle to cycle based on both qualitative and quantitative methods by using the infographic design rubric and researcher observations acquired during implementation. Respectively, twenty-three, twenty-four, and twenty-four secondary school students participated in the infographic creation process cycles. Contribution: This research proposes an extensive step-by-step process model for creating infographics as a method of visualization for learning. It is particularly relevant for working with complex information, in that it enables collaborative knowledge construction and sharing of condensed knowledge. Findings: Creating infographics can be an effective method for collaborative learning situations by enabling knowledge construction, visualization and sharing. The Bridge21 activity model constituted the spine of the infographic creation process. The content generation, draft generation, and visual and digital design generation components of the infographic design model matched with the investigate, plan and create phases of the Bridge21 activity model respectively. Improvements on infographic design results from cycle to cycle suggest that the revisions on the process model succeeded in their aims. The rise in each category was found to be significant, but the advance in visual design generation was particularly large. Recommendations for Practitioners: The effectiveness of the creation process and the quality of the results can be boosted by using relevant activities based on learner prior knowledge and skills. While infographic creation can lead to a focus on visual elements, the importance of wording must be emphasized. Being a multidimensional process, groups need guidance to ensure effective collaboration. Recommendation for Researchers: The proposed collaborative infographic creation process could be structured and evaluated for online learning environments, which will improve interaction and achievement by enhancing collaborative knowledge creation. Impact on Society: In order to be knowledge constructors, innovative designers, creative communicators and global collaborators, learners need to be surrounded by adequate learning environments. The infographic creation process offers them a multidimensional learning situation. They must understand the problem, find an effective way to collect information, investigate their data, develop creative and innovative perspectives for visual design and be comfortable for using digital creation tools. Future Research: The infographic creation process could be investigated in terms of required learner prior knowledge and skills, and could be enhanced by developing pre-practices and scaffolding.

Aim/Purpose: The current study examines the impact of an intervention program to train teachers to collaborate with their students while creating digital games. Background: Teachers seem unable to leverage the potential of ICT to present students with a rich learning environment. ICT integration is usually at a relatively simple and concrete level without changing the traditional teacher-student paradigm. Methodology: The study is both quantitative and qualitative. Participants were 63 active teachers studying in the M.Ed. program at a teacher education college. The teachers responded to a series of pre- and post-questionnaires and wrote a concluding reflection. Contribution: Teaching based on creating digital games, combined with teacher-class collaboration, is a viable and real alternative of constructivist teaching, adapted to different learners. Findings: The SEM path analysis showed that it was only after the intervention that the lower the teachers’ resistance to changing teaching patterns, the higher their intrinsic motivation to learn an innovative pedagogical-technological program and likewise the sense of mastery of 21st-century skills, resulting in a positive attitude towards classroom collaboration. The qualitative findings reveal eight categories dealing with two main themes: the first is professional development, including conceptual, behavioral and emotional change, and the second is the teachers’ perception of the learners. Recommendations for Practitioners: Teacher training should be ongoing in order to change teaching-learning processes and promote an active approach based on constructive principles, 21st-century skills and collaboration between teachers and students in a computer environment. Recommendation for Researchers: Future studies should start by sampling teachers and education professionals who have convenient access to technology in their teaching-learning environment. Impact on Society: Collaboration between teachers and students in creating learning games in a computer environment and teacher-class collaboration, in general, require very different training than that which exists today. Hence there should be some rethinking of teacher training. The proposed pedagogical model is one such idea in the right direction. Future Research: A larger study with a greater number of participants, including a control group, should be conducted.

Aim/Purpose: The study examined types of errors made by novice programmers in different Java concepts with students of different ability levels in programming as well as the perceived causes of such errors. Background: To improve code writing and debugging skills, efforts have been made to taxonomize programming errors and their causes. However, most of the studies employed omnibus approaches, i.e. without consideration of different programing concepts and ability levels of the trainee programmers. Such concepts and ability specific errors identification and classifications are needed to advance appropriate intervention strategy. Methodology: A sequential exploratory mixed method design was adopted. The sample was an intact class of 124 Computer Science and Engineering undergraduate students grouped into three achievement levels based on first semester performance in a Java programming course. The submitted codes in the course of second semester exercises were analyzed for possible errors, categorized and grouped across achievement level. The resulting data were analyzed using descriptive statistics as well as Pearson product correlation coefficient. Qualitative analyses through interviews and focused group discussion (FGD) were also employed to identify reasons for the committed errors. Contribution:The study provides a useful concept-based and achievement level specific error log for the teaching of Java programming for beginners. Findings: The results identified 598 errors with Missing symbols (33%) and Invalid symbols (12%) constituting the highest and least committed errors respec-tively. Method and Classes concept houses the highest number of errors (36%) followed by Other Object Concepts (34%), Decision Making (29%), and Looping (10%). Similar error types were found across ability levels. A significant relationship was found between missing symbols and each of Invalid symbols and Inappropriate Naming. Errors made in Methods and Classes were also found to significantly predict that of Other Object concepts. Recommendations for Practitioners: To promote better classroom practice in the teaching of Java programming, findings for the study suggests instructions to students should be based on achievement level. In addition to this, learning Java programming should be done with an unintelligent editor. Recommendations for Researchers: Research could examine logic or semantic errors among novice programmers as the errors analyzed in this study focus mainly on syntactic ones. Impact on Society: The digital age is code-driven, thus error analysis in programming instruction will enhance programming ability, which will ultimately transform novice programmers into experts, particularly in developing countries where most of the software in use is imported. Future Research: Researchers could look beyond novice or beginner programmers as codes written by intermediate or even advanced programmers are still not often completely error free.

Aim/Purpose: In this study, the researchers investigated whether the out-of-class learning approach could help the students to attain any valuable learning outcomes for cybersecurity learning and could enhance the perceived value of cybersecurity education among the students. Background: Cybersecurity learning poses challenges for its students to learn a complicated subject matter and the students may be intimidated by the challenging courses in cybersecurity programs. Therefore, it is essential for the faculty members to devise some mechanisms to promote cybersecurity learning to increase its student retention. The mechanism suggested by this study was the out-of-class learning approach. Methodology: The researchers in this study employed a content analysis and adopted a semiotic method to analyze qualitative data. The researchers also conducted crosstabulation analyses using chi-square tests to detect the significant differences in the emerging learning outcomes from the two different out-of-class learning activities investigated in this study. Contribution: This study addressed the difficulty of cybersecurity education and proposed a viable mechanism to promote the student learning in such a complicated subject matter. Findings: For cybersecurity education, the out-of-class learning approach is a viable pedagogical mechanism that could lead the students to several learning outcomes, including connecting them to the real-life scenarios related to the cybersecurity profession, guiding them to their career choices and development, stimulating their intellectual growth, creating their justification of learning, and raising their cybersecurity awareness. Recommendations for Practitioners: The instructors of any cybersecurity programs should incorporate some out-of-class learning activities into the courses in their programs, especially the introductory-level courses. Additionally, it is important to coordinate the out-of-class learning activities with the in-class lessons to enable the students to justify what they have learned in their classrooms and motivate them to learn more. Recommendation for Researchers: Researchers could look beyond in-class learning and laboratory learning to investigate the impacts of out-of-class learning activities on cybersecurity education to help the students to attain better learning outcomes. Impact on Society: By promoting cybersecurity education, universities and colleges could attain a higher retention rate of the students in their cybersecurity programs. The higher retention rate of the students in cybersecurity programs would help to ease the critical shortage of cybersecurity talent. Future Research: Future research could explore the impacts of other out-of-class learning activities on cybersecurity learning; for example: job shadowing, attending cybersecurity conferences, internship, developing cybersecurity systems or tools for actual customers, working on cybersecurity research with faculty members. Additionally, future studies could investigate the effects of the out-of-class learning approach on promoting other academic programs that are characterized by intensely complex and technical nature, similar to cybersecurity programs.

Aim/Purpose: This paper reports on a case study project which had three goals; to develop a suite of original interactive digital skills e-tutorials to be embedded in undergraduate and postgraduate courses; to evaluate the students’ experience and engagement with the e-tutorials over one semester; and to explore their general attitudes towards online and blended learning. Background: Online and blended learning modes continue to grow in popularity in higher education, with the aim of streamlining and enhancing student learning, supporting collaboration and creativity, and equipping students with the skills they will require to work and live in an increasingly digitized world. This practice-based case study highlights factors which positively and negatively affect user engagement with digital learning objects and explores students’ perceptions of the role of online learning within their academic programs. Methodology: A suite of nine interactive e-tutorials, addressing essential digital literacy skills for university students, was developed through instructor and student peer collaboration using Articulate software, informed by best practice. The e-tutorials were embedded in the institutional Learning Management System for three undergraduate and postgraduate courses, in which digital literacy formed the core learning content, to complement classroom-based learning. Students in these courses were surveyed via SurveyMonkey about their specific experience of using the e-tutorials, as well as their general perceptions of digital literacy and online learning. Eighty-six students in total completed the questionnaire, which consisted of twenty-three closed- and open-ended questions. Contribution: Through highlighting both the positive and the challenging aspects of the students’ reported experience of online learning, this case study contributes useful insights to the body of literature on user engagement with digital learning objects in higher education, as well as students’ perceptions and experience of blended learning. Findings: The e-tutorials were perceived as valuable in reinforcing classroom learning, allowing respondents to revise concepts and materials covered in face-to-face classes, at their own pace and in their own time. Survey responses showed that the accessibility, ease-of-use, design and duration of the e-tutorials were deemed effective in terms of user engagement; however, several technological challenges were identified, such as browser incompatibility, uneven sound quality and general Internet connection issues, which disrupted their learning. Overall, students expressed enjoyment of the learning facilitated by the e-tutorials; however, rather than favoring online learning alone, they expressed a preference for a blended learning environment, with a combination of complementary learning approaches; survey respondents did not generally wish to forego face-to-face classes entirely. Recommendations for Practitioners: Instructors should seek to strategically embed interactive digital learning objects in their courses at defined points of need in a logical structure, e.g., to reinforce classroom-based learning, or to support specific skill development. Potential disruption to learning should be minimized by following best practice guidelines to ensure ease of access, a seamless user experience, and timely feedback, as well as providing adequate support for rapid resolution of technical glitches. Recommendation for Researchers: E-tutorials offer a useful means of exploring ways in which students acquire learning in the digital environment. A wider, collaborative exploration is needed to provide comparative studies which move beyond case studies. Impact on Society: Online learning mechanisms, such as e-tutorials, offer students different means of acquiring essential literacy skills and different ways to interact with content. E-tutorials constitute reusable learning objects, which can be accessed as just-in-time delivery modes, when students perceive they need to review particular skills or reinforce learning material. Future Research: This research is now expanding into different types of reusable learning objects. E-tutorials may be developed in multiple ways, and comparative research around e-tutorial models will deepen our understanding of how students interact with content in formal learning contexts. As the digital educational landscape continues to expand alongside traditional face-to-face and analogue learning modes, a key research focus will be student and instructor perceptions and experience of blended learning in different contexts.

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 18, 2019

Aim/Purpose: Although many computer science measures have been proposed, visualizing individual students’ capabilities is difficult, as those measures often rely on specific tools and methods or are not graded. To solve these problems, we propose a rubric for measuring and visualizing the effects of learning computer programming for elementary school students enrolled in computer science education (CSE), which is independent of the programming language being used. Background: In this research, we proposed a rubric based on existing CSE standards and criteria having a programming education-learning goal. We then applied this rubric to actual lessons to visualize the educational effects. Methodology: The proposed new rubric for teaching computer programming, based on existing standards and criteria, was applied to fourth- and sixth-grade students in Japan. We assessed which skills were cultivated through quizzes before and after the teaching. Contribution: This paper contributes on how to make and utilize a rubric for programming education in computer science. We evaluated and visualized the proposed rubric’s learning effects on children and found that our proposed rubrics are independent of any particular method or tool. Findings: The results of this survey are twofold: (1) we proposed a rubric of programming education in computer science, independent of the programming tools used and (2) we succeeded in visualizing students’ learning stages by applying the proposed rubric to programming education conducted in a Japanese elementary school. Recommendations for Practitioners: Evaluating educational effects in CSE is important. In particular, graded assessments of learner abilities can reveal individual characteristics. This research is useful for assessing CSE because it focuses specifically on programming education. Recommendation for Researchers: The rubric’s suggestions and quality improvements in CSE help learners assess their learning progress and will clarify the cultivated computer science skills. Impact on Society: This research evaluates CSE based on a rubric in the programming education field. Future Research: Future work is needed to improve the proposed rubric’s quality and relevance. Also, this rubric should be applied to many classes to increase the number of evaluations and analyses.

Aim/Purpose: This paper presents a study about changes in computer science and software engineering students’ perceptions of their soft skills during their progress through the Computer Science Soft Skills course. Background: Soft skills are often associated with a person’s social, emotional and cognitive capabilities. Soft skills are increasingly sought out and are well recognized by employers alongside standard qualifications. Therefore, high importance is attributed to soft skills in computer science and software engineering education. Methodology: Content analysis was applied to interpret, categorize and code statements from students’ course assignment answers. Data analysis was performed gradually at the three main stages of the course and by the two students’ study populations. Contribution: The paper highlights the variety of (a) soft skills that can be learnt in one course, both on the individual level and on the team level and (b) assignments that can be given to students to increase their awareness and motivation to practice and learn soft skills. Findings: Data analysis revealed the following: (a) five individual soft skills categories, with 95 skills, and five team-related soft skills categories, with 52 skills (in total, the students mentioned 147 soft skills); (b) course assignments and particularly team-based activities elicited student awareness of their individual soft skills, both as strengths and weaknesses; (c) students developed their reflection skills, particularly with respect to team-related soft skills; and (d) significant differences exist between the two groups of students in several categories. Recommendations for Practitioners: It is important to provide undergraduate students with opportunities to integrate soft skills during their training. Establishing a meaningful learning process, such as project-based learning, enables students to apply and develop soft skills when accompanied by reflective thought processes. Recommendation for Researchers: A similar course can be taught and be accompanied by similar analysis of students’ learning outcomes, to examine the influence of local culture on the characteristics of soft skills. Impact on Society: Increased awareness of soft skills in scientists and engineers’ undergraduate education. University graduates who will strengthen their variety of soft skills in their academic training process and will be more meaningful employees in the workplace and in society. Future Research: Our future research aims (a) to explore additional innovative ways to increase students’ learning processes, awareness and practices in relation to soft skills and (b) to research how students’ soft skills are developed during the entire undergraduate studies both on the individual level and the team level.

Aim/Purpose: The purpose of this study is to develop an efficient methodology that can assist the evaluators in assessing a variable number of individuals that are working in groups and guarantee that the assessment is dependent on the group members’ performance and contribution to the work developed. Background: Collaborative work has been gaining more popularity in academic settings. However, group assessment needs to be performed according to each individual’s performance. The problem rests on the need to distinguish each member of the group in order to provide fair and unbiased assessments. Methodology: Design Science Research methodology supported the design of a framework able to provide the evaluator with the means to distinguish individuals in a workgroup and deliver fair results. Hevner’s DSR guidelines were fulfilled in order to describe WebAVALIA. To evaluate the framework, a quantitative study was performed and the first results are presented. Contribution: This paper provides a methodological solution regarding a fair evaluation of collaborative work through a tool that allows its users to perform their own assessment and peer assessment. These are made accordingly to the user’s perspectives on the performance of each group member throughout the work development. Findings: The first analysis of the results indicates that the developed method provides fairness in the assessment of group members, delivering a distinction amongst individuals. Therefore, each group member obtains a mark that corresponds to their specific contribution to the workgroup. Recommendations for Practitioners: For those who intend to apply this workgroup assessment method, it is relevant to raise student awareness about the methodology that is going to be used. That is, all the functionalities and steps in WebAVALIA have to be thoroughly explained before beginning of the project. Then, the evaluators have to decide about the students’ intermediate voting, namely if the evaluator chooses or not to publish student results throughout the project’s development. If there is the decision to display these intermediate results, the evaluator must try to encourage collaboration among workgroup members, instead of competition. Recommendation for Researchers: This study explores the design and development of an e-assessment tool – WebAVALIA. In order to assess its feasibility, its use in other institutions or contexts is recommended. The gathering of user opinions is suggested as well. It would then be interesting to compare the findings of this study with the results from other experimentations Impact on Society: Sometimes, people develop a rejection of collaborative work because they feel exploited due to the biased evaluation results. However, the group members assessment distinction, according to each one’s performance, may give each individual a sense of fairness and reward, leading to an openness/willingness towards collaborative work. Future Research: As future work, there are plans to implement the method in other group assessment contexts – such as sports and business environments, other higher education institutions, technical training students – in other cultures and countries. From this myriad of contexts, satisfaction results would be compared. Other future plans are to further explore the mathematical formulations and the respective WebAVALIA supporting algorithms.

Aim/Purpose: The current study was conducted to investigate the students’ perceived satisfaction with the use of a semantic-based online laboratory, which provides students with a search mechanism for laboratory resources, such as instruments and devices. Background: The increasing popularity of using online teaching labs, as an important element of experiential learning in STEM education, is because they represent a collection of integrated tools that allow students and teachers to interact and work collaboratively, whereas they provide an enriched learning content delivery mechanism. Moreover, several research studies have proposed various approaches for online teaching laboratories. However, there are hardly any studies that examine the student satisfaction provided by online laboratories based on students’ experiential learning. Methodology: To measure the effectiveness of the laboratory, we performed a case study in a Computer Fundamentals online course in which undergraduate students were able to manage devices and instruments remotely. Participants were a sample of 50 third semester students of Bachelor’s degree in Information Technology Administration who were divided in experimental and control groups (online laboratory vs. traditional manner). Given a laboratory assignment, students were able to carry out the management of devices and instruments through a LabView virtual environment and web services. The data of the experiment were collected through two questionnaires from both groups. The first is a system usability score (SUS) questionnaire concerning lab usability and the second one students’ cognitive load. Contribution: The results of the study showed a high correlation between usability and cognitive load-satisfaction of students who used the online teaching laboratory compared to the students who did not use it. Findings: On the one hand, the online laboratory provided students with an easy way to share and deploy instruments and devices, thus enhancing system usability. On the other hand, it offered important facilities which enabled students to customize the search for instruments and devices, which certainly had a positive impact on the relationship between cognitive load and satisfaction. Recommendations for Practitioners: In this work we propose an intuitive laboratory interface as well as easiness to use but challenging and capable of providing similar experiences to the traditional laboratory. Recommendation for Researchers: This study is one of the first to analyze the cognitive load-satisfaction relationship and compare it with usability scores. Impact on Society: Our analyses make an important contribution to the literature by suggesting a correlation analysis comparing the results of experimental and control groups that participated in this research work, in terms of usability and cognitive load-satisfaction. Future Research: Future work will also investigate other methodological aspects of instructional design with the aim to improve personalized learning and reinforce collaborative experiences, as well as to deal with problems related to laboratory access, such as authentication, scheduling, and interoperability.

Aim/Purpose: In this paper, we present our experience in design and delivery of a graduate Information Systems Management (ISM) course in an online MBA program. Also presented are a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Background: This graduate ISM course needs to not only cover a broad range of dynamic technology and business topics, but also strike a balance between the width and depth of the content. Effective course design and delivery are critical to improved teaching and learning, especially when the course is delivered online. Methodology: We provided a comprehensive review of the related literature to develop guidelines for the design and delivery of our ISM course; we collected survey data to evaluate the students’ backgrounds and their perceptions of the course; we used data analysis and content analysis methods to assess the course evaluation results. Contribution: A review of the related literature indicates that IS researchers and educators have not adequately studied online graduate education. Given the importance of the graduate ISM course in most MBA programs, and the lack of attention from the IS community, it is critical to address this gap in the research. We believe we have done so with this paper. Findings: The paper’s major findings are embedded in a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Recommendations for Practitioners: Even though our experience may not be fully applicable to other institutions, we hope our IS colleagues can learn from the design and delivery of this online course, as well as our best practices and lessons learned to improve the teaching and learning effectiveness in IS online graduate education, in general. Furthermore, we provide instructors with an actionable framework onto which they can map their current course offering, and compare their current pedagogical offering to literature driven best practices for ISM courses, in particular. Recommendation for Researchers: It is our hope that the design and delivery of this online course, and our best practices and lessons learned can inspire our IS colleagues to search for innovative ways to improve the teaching and learning effectiveness in IS online graduate education. In addition, we distill a literature driven framework for ISM courses design and delivery that can help researchers frame their pedagogical research questions. Impact on Society: The online course in this study prepares students for more efficiently and effectively delivering IT systems in organizations. Many MBA students work for non-profits and other socially-focused organizations and are able to use the skills learned in the course for the betterment of society. Future Research: We will continue to monitor the impact of the changes on student learning effectiveness and attempt to identify additional innovative ways to improve the design and delivery of this online ISM course.

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 19, 2020

Aim/Purpose: The purpose of this paper is to develop and evaluate a debiasing-based approach to assessing the learning materials in problem-based learning (PBL) environments. Background: Research in cognitive debiasing suggests nine debiasing strategies improve decision-making. Given the large number of decisions made in semester-long, problem-based learning projects, multiple tools and techniques help students make decisions. However, instructors may struggle to identify the specific tools or techniques that could be modified to best improve students’ decision-making in the project. Furthermore, a structured approach for identifying these modifications is lacking. Such an approach would match the debiasing strategies with the tools and techniques. Methodology: This debiasing framework for the PBL environment is developed through a study of debiasing literature and applied within an e-commerce course using the Model for Improvement, continuous improvement process, as an illustrative case to show its potential. In addition, a survey of the students, archival information, and participant observation provided feedback on the debiasing framework and its ability to assess the tools and techniques within the PBL environment. Contribution: This paper demonstrates how debiasing theory can be used within a continuous improvement process for PBL courses. By focusing on a cognitive debiasing-based approach, this debiasing framework helps instructors 1) identify what tools and techniques to change in an PBL environment, and 2) assess which tools and techniques failed to debias the students adequately, providing potential changes for future cycles. Findings: Using the debiasing framework in an e-commerce course with significant PBL elements provides evidence that this framework can be used within IS courses and more broadly. In this particular case, the change identified in a prior cycle proved effective and additional issues were identified for improvement. Recommendations for Practitioners: With the growing usage of semester-long PBL projects in business schools, instructors need to ensure that their design of the projects incorporates techniques that improve student learning and decision making. This approach provides a means for assessing the quality of that design. Recommendation for Researchers: This study uses debiasing theory to improve course techniques. Researchers interested in assessment, course improvement, and program improvement should incorporate debiasing theory within PBL environments or other types of decision-making scenarios. Impact on Society: Increased awareness of cognitive biases can help instructors, students, and professionals make better decisions and recommendations. By developing a framework for evaluating cognitive debiasing strategies, we help instructors improve projects that prepare students for complex and multifaceted real-world projects. Future Research: The approach could be applied to multiple contexts, within other courses, and more widely within information systems to extend this research. The framework might also be refined to make it more concise, integrated with assessment, or usable in more contexts.

Aim/Purpose: This paper investigates the influence of university student multitasking on their learning success, defined as students’ learning satisfaction and performance. Background: Most research on student multitasking finds student multitasking problematic. However, this research is generally from 2010. Yet, today’s students are known to be digital natives and they have a different, more positive, relationship with mobile technologies. Based on the old findings, most instructors ban mobile technology use during instruction, and design their online courses without regard for the mobile technology use that happens regardless of their ban. This study investigates whether today’s instructors and learning management system interface designers should take into account multitasking with mobile technologies. Methodology: A quasi-experimental design was used in this study. Data were collected from 117 students across two sections of an introductory Management Information Systems class taught by the first author. We took multiple approaches and steps to control for confounding factors and to increase the internal validity of the study. We used a control group as a comparison group, we used a pre-test, we controlled for selection bias, and we tested for demographic differences between groups. Contribution: With this paper, we explicated the relationship between multitasking and learning success. We defined learning success as learning performance and learning satisfaction. Contrary to the literature, we found that multitasking involving IT texting does not decrease students’ learning performance. An explanation of this change is the change in the student population, and the digital nativeness between 2010s and 2020 and beyond. Findings: Our study showed that multitasking involving IT texting does not decrease students’ performance in class compared to not multitasking. Secondly, our study showed that, overall, multitasking reduced the students’ learning satisfaction despite the literature suggesting otherwise. We found that attitude towards multitasking moderated the relationship between multitasking and learning satisfaction as follows. Individuals who had a positive attitude towards multitasking had high learning satisfaction with multitasking. However, individuals who had positive attitude toward multitasking did not necessarily have higher learning performance. Recommendations for Practitioners: We would recommend both instructors and the designers of learning management systems to take mobile multitasking into consideration while designing courses and course interfaces, rather than banning multitasking, and assuming that the students do not do it. Furthermore, we recommend including multitasking into relevant courses such as Management Information Systems courses to make students aware of their own multitasking behavior and their results. Recommendation for Researchers: We recommend that future studies investigate multitasking with different instruction methods, especially studies that make students aware of their multitasking behavior and its outcomes will be useful for next generations. Impact on Society: This paper investigates the role of mobile multitasking on learning performance. Since mobile technologies are ubiquitous and their use in multitasking is common, their use in multitasking affects societal performance. Future Research: Studies that replicate our research with larger and more diverse samples are needed. Future research could explore research-based experiential teaching methods, similar to this study.

Aim/Purpose: Business analytics is a cross-functional field that is important to implement for a college and has emerged as a critically important core component of the business curriculum. It is a difficult task due to scheduling concerns and limits to faculty and student resources. This paper describes the process of creating a central video repository to serve as a platform for just in time teaching and the impact on student learning outcomes. Background: Industry demand for employees with analytical knowledge, skills, and abilities requires additional analytical content throughout the college of business curriculum. This demand needs other content to be added to ensure that students have the prerequisite skills to complete assignments. Two pedagogical approaches to address this issue are Just-in-Time Teaching (JiTT) and scaffolding, grounded in the Vygoskian concept of “Zone of Proximal Development. Methodology: This paper presents a case study that applies scaffolding and JiTT teaching to create a video repository to add business analytics instruction to a curriculum. The California Critical Thinking Skills Test (CCTST) and Major Field Test (MFT) scores were analyzed to assess learning outcomes. Student and faculty comments were considered to inform the results of the review. Contribution: This paper demonstrates a practical application of scaffolding and JiTT theory by outlining the process of using a video library to provide valuable instructional resources that support meaningful learning, promote student academic achievement, and improve program flexibility. Findings: A centrally created library is a simple and inexpensive way to provide business analytics course content, augmenting standard content delivery. Assessment of learning scores showed an improvement, and a summary of lessons learned is provided to guide implications. Recommendations for Practitioners: Pedagogical implications of this research include the observation that producing a central library of instructor created videos and assignments can help address knowledge and skills gaps, augment the learning of business analytics content, and provide a valuable educational resource throughout the college of business curriculum. Recommendation for Researchers: This paper examines the use of scaffolding and JiTT theories. Additional examination of these theories may improve the understanding and limits of these concepts as higher education evolves due to the combination of market forces changing the execution of course delivery. Impact on Society: Universities are tasked with providing new and increasing skills to students while controlling the costs. A centrally created library of instructional videos provides a means of delivering meaningful content while controlling costs. Future Research: Future research may examine student success, including the immediate impact of videos and longitudinally using video repositories throughout the curriculum. Studies examining the approach across multiple institutions may help to evaluate the success of video repositories. Faculty acceptance of centrally created video libraries and assignments should be considered for the value of faculty recruiting and use in the classroom. The economic impact on both the university and students should be evaluated.

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 20, 2021

Aim/Purpose: This paper focuses on designing and implementing the rubric for objective JAVA programming assessments. An unsupervised learning approach was used to group learners based on their performance in the results obtained from the rubric, reflecting their learning ability. Background: Students' learning outcomes have been evaluated subjectively using a rubric for years. Subjective assessments are simple to construct yet inconsistent and biased to evaluate. Objective assessments are stable, reliable, and easy to conduct. However, they usually lack rubrics. Methodology: In this study, a Top-Down assessment approach is followed, i.e., a rubric focused on the learning outcome of the subject is designed, and the proficiency of learners is judged by their performance in conducting the task given. A JAVA rubric is proposed based on the learning outcomes like syntactical, logical, conceptual, and advanced JAVA skills. A JAVA objective quiz (with multiple correct options) is prepared based on the rubric criteria, comprising five questions per criterion. The examination was conducted for 209 students (100 from the MCA course and 109 from B.Tech. course). The suggested rubric was used to compute the results. K-means clustering was applied to the results to classify the students according to their learning preferences and abilities. Contribution: This work contributes to the field of rubric designing by creating an objective programming assessment and analyzing the learners’ performance using machine learning techniques. It also facilitates a reliable feedback approach offering various possibilities in student learning analytics. Findings: The designed rubric, partial scoring, and cluster analysis of the results help us to provide individual feedback and also, group the students based on their learning skills. Like on average, learners are good at remembering the syntax and concepts, mediocre in logical and critical thinking, and need more practice in code optimization and designing applications. Recommendations for Practitioners: The practical implications of this work include rubric designing for objective assessments and building an informative feedback process. Faculty can use this approach as an alternative assessment measure. They are the strong pillars of e-assessments and virtual learning platforms. Recommendation for Researchers: This research presents a novel approach to rubric-based objective assessments. Thus, it provides a fresh perspective to the researchers promising enough opportunities in the current era of digital education. Impact on Society: In order to accomplish the shared objective of reflective learning, the grading rubric and its accompanying analysis can be utilized by both instructors and students. As an instructional assessment tool, the rubric helps instructors to align their pedagogies with the students’ learning levels and assists students in updating their learning paths based on the informative topic-wise scores generated with the help of the rubric. Future Research: The designed rubric in this study can be extended to other programming languages and subjects. Further, an adaptable weighted rubric can be created to execute a flexible and reflective learning process. In addition, outcome-based learning can be achieved by measuring and analyzing student improvements after rubric evaluation.

Aim/Purpose: To encourage students’ engagement in peer assessments and provide students with better-quality feedback, this paper describes a technique for author-reviewer matching in peer assessment systems – a Balanced Allocation algorithm. Background: Peer assessment concerns evaluating the work of colleagues and providing feedback on their work. This process is widely applied as a learning method to involve students in the progress of their learning. However, as students have different ability levels, the efficacy of the peer feedback differs from case to case. Thus, peer assessment may not provide satisfactory results for students. In order to mitigate this issue, this paper explains and evaluates an algorithm that matches the author to a set of reviewers. The technique matches authors and reviewers based on how difficult the authors perceived the assignment to be, and the algorithm then matches the selected author to a group of reviewers who may meet the author’s needs in regard to the selected assignment. Methodology: This study used the Multiple Criteria Decision-Making methodology (MCDM) to determine a set of reviewers from among the many available options. The weighted sum method was used because the data that have been collected in user profiles are expressed in the same unit. This study produced an experimental result, examining the algorithm with a real collected dataset and mock-up dataset. In total, there were 240 students in the real dataset, and it contained self-assessment scores, peer scores, and instructor scores for the same assignment. The mock-up dataset created 1000 records for self-assessment scores. The algorithm was evaluated using focus group discussions with 29 programming students and interviews with seven programming instructors. Contribution: This paper contributes to the field in the following two ways. First, an algorithm using a MCDM methodology was proposed to match authors and reviewers in order to facilitate the peer assessment process. In addition, the algorithm used self-assessment as an initial data source to match users, rather than randomly creating reviewer – author pairs. Findings: The findings show the accurate results of the algorithm in matching three reviewers for each author. Furthermore, the algorithm was evaluated based on students’ and instructors’ perspectives. The results are very promising, as they depict a high level of satisfaction for the Balanced Allocation algorithm. Recommendations for Practitioners: We recommend instructors to consider using the Balanced Allocation algorithm to match students in peer assessments, and consequently to benefit from personalizing peer assessment based on students' needs. Recommendation for Researchers: Several MCDM methods could be expanded upon, such as the analytic hierarchy process (AHP) if different attributes are collected, or the artificial neural network (ANN) if fuzzy data is available in the user profile. Each method is suitable for special cases depending on the data available for decision-making. Impact on Society: Suitable pairing in peer assessment would increase the credibility of the peer assessment process and encourage students’ engagement in peer assessments. Future Research: The Balanced Allocation algorithm could be applied using a single group, and a peer assessment with random matching with another group may also be conducted, followed by performing a t-test to determine the impact of matching on students’ performances in the peer assessment activity.

Aim/Purpose: This paper proposes a new approach to developing a deep learning-based prototyping wearable model which can assist blind and visually disabled people to recognize their environments and navigate through them. As a result, visually impaired people will be able to manage day-to-day activities and navigate through the world around them more easily. Background: In recent decades, the development of navigational devices has posed challenges for researchers to design smart guidance systems for visually impaired and blind individuals in navigating through known or unknown environments. Efforts need to be made to analyze the existing research from a historical perspective. Early studies of electronic travel aids should be integrated with the use of assistive technology-based artificial vision models for visually impaired persons. Methodology: This paper is an advancement of our previous research work, where we performed a sensor-based navigation system. In this research, the navigation of the visually disabled person is carried out with a vision-based 3D-designed wearable model and a vision-based smart stick. The wearable model used a neural network-based You Only Look Once (YOLO) algorithm to detect the course of the navigational path which is augmented by a GPS-based smart Stick. Over 100 images of each of the three classes, namely straight path, left path and right path, are being trained using supervised learning. The model accurately predicts a straight path with 79% mean average precision (mAP), the right path with 83% mAP, and the left path with 85% mAP. The average accuracy of the wearable model is 82.33% and that of the smart stick is 96.14% which combined gives an overall accuracy of 89.24%. Contribution: This research contributes to the design of a low-cost navigational standalone system that will be handy to use and help people to navigate safely in real-time scenarios. The challenging self-built dataset of various paths is generated and transfer learning is performed on the YOLO-v5 model after augmentation and manual annotation. To analyze and evaluate the model, various metrics, such as model losses, recall value, precision, and maP, are used. Findings: These were the main findings of the study: • To detect objects, the deep learning model uses a higher version of YOLO, i.e., a YOLOv5 detector, that may help those with visual im-pairments to improve their quality of navigational mobilities in known or unknown environments. • The developed standalone model has an option to be integrated into any other assistive applications like Electronic Travel Aids (ETAs) • It is the single neural network technology that allows the model to achieve high levels of detection accuracy of around 0.823 mAP with a custom dataset as compared to 0.895 with the COCO dataset. Due to its lightning-speed of 45 FPS object detection technology, it has become popular. Recommendations for Practitioners: Practitioners can help the model’s efficiency by increasing the sample size and classes used in training the model. Recommendation for Researchers: To detect objects in an image or live cam, there are various algorithms, e.g., R-CNN, Retina Net, Single Shot Detector (SSD), YOLO. Researchers can choose to use the YOLO version owing to its superior performance. Moreover, one of the YOLO versions, YOLOv5, outperforms its other versions such as YOLOv3 and YOLOv4 in terms of speed and accuracy. Impact on Society: We discuss new low-cost technologies that enable visually impaired people to navigate effectively in indoor environments. Future Research: The future of deep learning could incorporate recurrent neural networks on a larger set of data with special AI-based processors to avoid latency.

Aim/Purpose: This research aims to describe layering of career-like experiences over existing curriculum to improve perceived educational value. Background: Feedback from students and regional businesses showed a clear need to increase student’s exposure to career-like software development projects. The initial goal was to develop an instructor-optional project that could be used in a single mid-level programming course; however, the pilot quickly morphed into a multi-year study examining the feasibility of agile projects in a variety of settings. Methodology: Over the course of four years, an agile project was honed through repeated Design Based Research (DBR) cycles of design, implementation, testing, communication, and reflective analysis. As is common with DBR, this study did not follow single methodology design; instead, analysis of data coupled with review of literature led to exploration and testing of a variety of methodologies. The review phase of each cycle included examination of best practices and methodologies as determined by analysis of oral and written comments, weekly journals, instructor feedback, and surveys. As a result of participant feedback, the original project was expanded to a second project, which was tested in another Software Engineering (SE) course. The project included review and testing of many academic and professional methodologies, such as Student Ownership of Learning, Flipped Classroom, active learning, waterfall, agile, Scrum, and Kanban. The study was homogenous and quasi-experimental as the population consisted solely of software engineering majors taking required courses; as based on validity of homogenous studies, class sizes were small, ranging from 8 to 20 students. Close interactions between respondents and the instructor provided interview-like settings and immersive data capture in a natural environment. Further, the iterative development practices of DBR cycles, along with the inclusion of participants as active and valued stakeholders, was seen to align well with software development practitioner practices broadly known as agile. Contribution: This study is among the first to examine layering a career-like software development project on top of a course through alteration of traditional delivery, agile development, and without supplanting existing material. Findings: In response to industry recommendations for additional career-like experiences, a standalone agile capstone-like project was designed that could be layered over an existing course. Pilot data reflected positive perceptions of the project, although students did not have enough time to develop a working prototype in addition to completing existing course materials. Participant feedback led to simultaneous development of a second, similar project. DBR examination of both projects resulted in a simplified design and the ability to develop a working prototype, if and only if the instructor was willing to make adjustments to delivery. After four years, a solution was developed that is both stable and flexible. The solution met the original charge in that it required course delivery, not course material, to be adjusted. It is critical to note that when a working prototype is desired, a portion of the lecture should be flipped allowing more time for guided instruction through project-focused active learning and study group requirements. The results support agile for standalone software development projects, as long as passive delivery methods are correspondingly reduced. Recommendations for Practitioners: Based on the findings, implementation of a career-like software development project can be well received as long as active learning components are also developed. Multiple cycles of DBR are recommended if future researchers wish to customize instructional delivery and develop complex software development projects. Programming instructors are recommended to explore hybrid delivery to support development of agile career-like experiences. Small class sizes allowed the researchers to maintain an interview-like setting throughout the study and future studies with larger classes are recommended to include additional subject matter experts such as graduate students as interaction with a subject matter expert was highly valued by students. Recommendation for Researchers: Researchers are recommended to further examine career-like software development experiences that combine active learning with agile methods; more studies following agile and active learning are needed to address the challenges faced when complex software development is taught in academic settings. Further testing of standalone agile project development has now occurred in medium sized in person classes, online classes, independent studies, and creative works research settings; however, further research is needed. Future research should also examine the implementation of agile projects in larger class sizes. Increasing class size should be coupled with additional subject matter experts such as graduate students. Impact on Society: This study addresses professional recommendations for development of agile career-like experiences at the undergraduate level. This study provides empirical evidence of programming projects that can be layered over existing curriculum, with no additional cost to the students. Initial feedback from local businesses and graduates, regarding agile projects with active learning, has been positive. The area business that refused to hire our underprepared SE graduates has now hired several. Future Research: Future research should explore layering agile projects over a broader range of software development courses. Feedback from hiring professionals and former students has been positive. It is also recommended that DBR be used to develop career-like experiences for online programming courses.

Aim/Purpose: The complexity of today’s organizational databases highlights the importance of hard technical skills as well as soft skills including teamwork, communication, and problem-solving. Therefore, when teaching students about databases it follows that using a team approach would be useful. Background: Team-based learning (TBL) has been developed and tested as an instructional strategy that leverages learning in small groups in order to achieve increased overall effectiveness. This research studies the impact of utilizing team-based learning strategies in an undergraduate Database Management course in order to determine if the methodology is effective for student learning related to database technology concepts in addition to student preparation for working in database teams. Methodology: In this study, a team-based learning strategy is implemented in an undergraduate Database Management course over the course of two semesters. Students were assessed both individually and in teams in order to see if students were able to effectively learn and apply course concepts on their own and in collaboration with their team. Quantitative and qualitative data was collected and analyzed in order to determine if the team approach improved learning effectiveness and allowed for soft skills development. The results from this study are compared to previous semesters when team-based learning was not adopted. Additionally, student perceptions and feedback are captured. Contribution: This research contributes to the literature on database education and team-based learning and presents a team-based learning process for faculty looking to adopt this methodology in their database courses. This research contributes by showing how the collaborative assessment aspect of team-based learning can provide a solution for the conceptual and collaborative needs of database education. Findings: Findings related to student learning and perceptions are presented illustrating that team-based learning can lead to improvements in performance and provides a solution for the conceptual and collaborative needs of database education. Specifically, the findings do show that team scores were significantly higher than individual scores when completing class assessments. Student perceptions of both their team members and the team-based learning process were overall positive with a notable difference related to the perception of team preparedness based on gender. Recommendations for Practitioners: Educational implications highlight the challenges of team-based learning for assessment (e.g., gender differences in perceptions of team preparedness), as well as the benefits (e.g., development of soft skills including teamwork and communication). Recommendation for Researchers: This study provides research implications supporting the study of team assessment techniques for learning and engagement in the context of database education. Impact on Society: Faculty looking to develop student skills in relation to database concepts and application as well as in relation to teamwork and communication may find value in this approach, ultimately benefiting students, employers, and society. Future Research: Future research may examine the methodology from this study in different contexts as well as explore different strategies for group assignments, room layout, and the impact of an online environment.

Table of Contents of the Journal of Information Technology Education: Innovations in Practice, Volume 21, 2022

Aim/Purpose: The purpose of this article is to provide an overview and analysis of the emerging research landscape surrounding the integration of ChatGPT into education. The main problem appears to be that this is a new, rapidly developing research area for which there is no comprehensive synthesis of the current literature. The aim of the article is to fill this gap by conducting a timely bibliometric study to map publication trends, influential works, themes, and opportunities, thus representing the growth and structure of ChatGPT educational research. Background: This article addresses the issue of the lack of a comprehensive synthesis of the new research on ChatGPT in education by conducting a bibliometric analysis. Specifically, the authors use statistical and network analysis techniques to examine the patterns of publication, citation, and keywords and map the growth, contributions, themes, structure, and opportunities in this evolving field. The bibliometric approach provides a comprehensive, evidence-based overview of the current state of the literature to uncover trends and gaps and help researchers improve their understanding of appropriate and effective applications of ChatGPT in educational contexts. Methodology: The authors used bibliometric analysis as the primary method to summarize the new research on ChatGPT in education. We searched the database of the Web of Science Core Collection to find 51 relevant documents from 2023 that included ChatGPT in the title and were classified as ‘educational research.’ The sample consisted of these 51 documents, including articles, early access articles, editorials, reviews, and letters. Statistical techniques examined publication, citation, and keyword patterns. Network analysis visualized citation and co-occurrence networks to reveal intellectual structure. The multifaceted bibliometric approach allowed a comprehensive study of the sample from a productive, conceptual, and intellectual perspective. Contribution: This article conducts comprehensive bibliometric analysis of this emerging research area and synthesizes publication, citation, and keyword data to map the growth and structure of the literature. The results reveal important trends, such as the rapid growth of publications since the release of ChatGPT, initial authorship patterns, the focus on higher education applications, and distinct research clusters around pedagogical, ethical, and assessment issues. Visualizing citation networks identifies seminal studies while mapping co-occurrence clarifies conceptual relationships between topics. The comparative analysis highlights the differences between document types, topics, and time periods. Knowledge mapping highlights gaps in the literature, such as lack of focus on K-12 contexts, and highlights opportunities for further research. Findings: Key findings from this bibliometric analysis of the emerging research land-scape surrounding ChatGPT integration in education include the following: • Since ChatGPT was released in late 2022, the number of releases has increased significantly, indicating rapid growth in this emerging space. • The most cited authors initially came primarily from Anthropic, but over time, the citations spread throughout the research community. • The topics focused primarily on higher education applications, with a clear focus on pedagogical strategies, ethical risks, and implications for assessment. • Citation networks visualized seminal studies, while the co-occurrence of keywords clarified conceptual connections. • Gaps such as applications in the K-12 context were uncovered, and opportunities for further research were highlighted. • The literature is rapidly evolving and requires ongoing monitoring of the development of this field. In general, the analysis presents the productivity, contributors, themes, struc-ture, and opportunities in this emerging area around the integration of ChatGPT in education based on current scientific evidence. The key findings focus on the growing early interest, gaps and developments that can provide insight for researchers and educators. Recommendations for Practitioners: Practitioners should carefully integrate ChatGPT into education based on new evidence, carefully assess contextual applicability, and proactively develop guidelines for ethical and equitable implementation. Ongoing advice, impact monitoring, and research partnerships are crucial to informing best practices. Educators must be vigilant for risks such as privacy, student well-being, and competence impairment while staying abreast of advances in knowledge to dynamically adapt integration strategies. The introduction should empower diverse learners through measured, integrative approaches based on continuous contextual analysis and ethical principles. Recommendation for Researchers: This article recommends that researchers conduct more studies in under-researched contexts, use multiple methods to capture nuanced impacts, increase focus on responsible integration strategies, develop tailored assessments, conduct interdisciplinary collaborations, monitor long-term adoption, mix with interactive explain and publish open access technologies, help guide adoption pathways through actionable studies, and synthesize the exponentially growing literature through updated systematic reviews. Impact on Society: The rapid publication growth and prevailing optimism suggest that the integration of ChatGPT into education will accelerate, increasing the need for rigorous research that guides ethical, responsible innovations that avoid risks and improve outcomes in all educational contexts. The findings have broader implications for guiding adoption trajectories through ongoing evidence synthesis and expanded investigations in under-researched areas to address knowledge gaps. Ultimately, continued monitoring and updated guidance are critical to ensure that ChatGPT’s educational penetration progresses carefully by maximizing benefits and minimizing harms in rapidly evolving AI-powered learning ecosystems. Future Research: Based on the basic mapping provided by this paper, recommended research directions include longitudinal impact studies, research tailored to under-researched contexts such as K-12, qualitative research to capture stakeholder perspectives, development and testing of AI-calibrated assessments as well as explorations that combine conversational and interactive learning technologies, updated systematic reviews, and co-designed implementation research that explain pedagogical strategies that ethically unlock learning potential while mitigating risks in diverse educational environments. Such multilayered tracking can provide critical insights to guide context-specific, responsible ChatGPT integration and monitor impact within rapidly evolving AI-powered education ecosystems.