ea Using Interactive Software to Teach Foundational Mathematical Skills By Published On :: 2016-01-26 The pilot research presented here explores the classroom use of Emerging Literacy in Mathematics (ELM) software, a research-based bilingual interactive multimedia instructional tool, and its potential to develop emerging numeracy skills. At the time of the study, a central theme of early mathematics curricula, Number Concept, was fully developed. It was broken down into five mathematical concepts including counting, comparing, adding, subtracting and decomposing. Each of these was further subdivided yielding 22 online activities, each building in a level of complexity and abstraction. In total, 234 grade one students from 12 classes participated in the two-group post-test study that lasted about seven weeks and for which students in the experimental group used ELM for about 30 minutes weekly. The results for the final sample of 186 students showed that ELM students scored higher on the standardized math test (Canadian Achievement Test, 2008) and reported less boredom and lower anxiety as measured on the Academic Emotions Questionnaire than their peers in the control group. This short duration pilot study of one ELM theme holds great promise for ELM’s continued development. Full Article
ea Teaching Quality Evaluation: Online vs. Manually, Facts and Myths By Published On :: 2017-12-13 Aim/Purpose: This study aimed to examine whether there is a difference between manual feedback and online feedback with regard to feedback quality, respondents’ percentage, reliability and the amount of verbal comments written by students. Background: The quality of teaching is an important component of academic work. There are various methods for testing the quality of teaching; one of these methods is through students’ feedback. Methodology: This study used a quantitative approach, including the quantification of qualitative verbal data collected through an open question in the questionnaire. A sample of 180 courses was randomly chosen, 90 courses were evaluated manually and 90 were evaluated online. The number of students ranges from 7 to 60 students per course. In total 4678 students participated in the study. Contribution: The findings show that there is almost an identical pattern of feedback of manual and online course teaching evaluation. These findings encourage a continued use of this evaluation method. Findings: No significant differences were found between manual feedback and online feedback in the students’ evaluation of the lecturer/course. The percentage of respondents was significantly higher in the manual feedback than in the online feedback. The number of qualitative comments was significantly greater in the online feedback than in the manual feedback. Impact on Society: The findings of this study refute the claims with regard to the unreliability of an online teaching evaluation. These findings reflect the advantages of using online feedback, such as cost savings, granting more time to students in order to provide feedback, and reducing disturbance during lectures. Future Research: The gender aspect was not taken into account in the study. Therefore, we recommend conducting a follow-up study that will examine gender differences in directions of- difference between male and female lecturers, and differences between male and female students in teaching evaluation. Full Article
ea The Influence of Teaching Methods on Learners’ Perception of E-safety By Published On :: 2017-10-24 Aim/Purpose: The traditional method of teaching e-safety by lecturing is not very effective. Despite learners often being equipped with the right knowledge, they reject the need to act accordingly. There is a need to improve the way digital e-safety is taught. Background: The study compares four different teaching styles, examining how each affected the way students perceive a range of e-safety keywords and consequently the way they approach this issue. Methodology: The semantic differential technique was used to carry out the research. Students completed a semantic differential questionnaire before and after lessons. A total of 405 first year undergraduates took part in the study. Contribution: The paper contributes to the debate on appropriate methods for teaching e-safety, with an aim to influence learners’ attitudes. Findings: Experience-based learning seems to be very effective, confronting students with an e-safety situation and providing them with a negative experience. This teaching method had the biggest influence on students who were deceived by the prepared e-safety risk situation. Recommendations for Practitioners: E-safety instruction can be enhanced by ensuring that lessons provide students with a personal experience. Recommendation for Researchers: The semantic differential technique can be used to measure changes in learners’ attitudes during the teaching process. Impact on Society: Our findings may bring improvements to the way e-safety topics are taught, which could, in turn, evoke in learners a more positive e-safety attitude and a desire to improve their e-safety behavior. Future Research: More research needs to be carried out to examine how the experiential learning method affects the attitudes of younger learners (primary, middle, and high school students). Full Article
ea Evaluating the Acceptability and Usability of EASEL: A Mobile Application that Supports Guided Reflection for Experiential Learning Activities By Published On :: 2017-07-28 Aim/Purpose: To examine the early perceptions (acceptability) and usability of EASEL (Education through Application-Supported Experiential Learning), a mobile platform that delivers reflection prompts and content before, during, and after an experiential learning activity. Background: Experiential learning is an active learning approach in which students learn by doing and by reflecting on the experience. This approach to teaching is often used in disciplines such as humanities, business, and medicine. Reflection before, during, and after an experience allows the student to analyze what they learn and why it is important, which is vital in helping them to understand the relevance of the experience. A just-in-time tool (EASEL) was needed to facilitate this. Methodology: To inform the development of a mobile application that facilitates real-time guided reflection and to determine the relevant feature set, we conducted a needs analysis with both students and faculty members. Data collected during this stage of the evaluation helped guide the creation of a prototype. The user experience of the prototype and interface interactions were evaluated during the usability phase of the evaluation study. Contribution: Both the needs analysis and usability assessment provided justification for continued development of EASEL as well as insight that guides current development. Findings: The interaction design of EASEL is understandable and usable. Both students and teachers value an application that facilitates real-time guided reflection. Recommendations for Practitioners: The use of a system such as EASEL can leverage time and location-based services to support students in field experiences. This technology aligns with evidence that guided reflection provides opportunities for metacognition. Recommendation for Researchers: Iterative prototyping, testing, and refinement can lead to a deliberate and effective app development process. Impact on Society: The EASEL platform leverages inherent functionality of mobile devices, such as GPS and persistent network connectivity, to adapt reflection tasks based on lo-cation or time. Students using EASEL will engage in guided reflection, which leads to metacognition and can help instructors scaffold learning Future Research: We will continue to advance the application through iterative testing and development. When ready, the application will be vetted in larger studies across varied disciplines and contexts. Full Article
ea The Impact of Hands-On Simulation Laboratories on Teaching of Wireless Communications By Published On :: 2017-03-15 Aim/Purpose: To prepare students with both theoretical knowledge and practical skills in the field of wireless communications. Background: Teaching wireless communications and networking is not an easy task because it involves broad subjects and abstract content. Methodology: A pedagogical method that combined lectures, labs, assignments, exams, and readings was applied in a course of wireless communications. Contribution: Five wireless networking labs, related to wireless local networks, wireless security, and wireless sensor networks, were developed for students to complete all of the required hands-on lab activities. Findings: Both development and implementation of the labs achieved a successful outcome and provided students with a very effective learning experience. Students expressed that they had a better understanding of different wireless network technologies after finishing the labs. Recommendations for Practitioners: Detailed instructional lab manuals should be developed so that students can carry out hands-on activities in a step-by-step fashion. Recommendation for Researchers: Hands-on lab exercises can not only help students understand the abstract technical terms in a meaningful way, but also provide them with hands-on learning experience in terms of wireless network configuration, implementation, and evaluation. Impact on Society: With the help of a wireless network simulator, students have successfully enhanced their practical skills and it would benefit them should they decide to pursue a career in wireless network design or implementation. Future Research: Continuous revision of the labs will be made according to the feedback from students. Based on the experience, more wireless networking labs and network issues could be studied in the future. Full Article
ea Learning by Doing: Twenty Successful Active Learning Exercises for Information Systems Courses By Published On :: 2017-01-19 Aim/Purpose: This paper provides a review of previously published work related to active learning in information systems (IS) courses. Background: There are a rising number of strategies in higher education that offer promise in regards to getting students’ attention and helping them learn, such as flipped classrooms and offering courses online. These learning strategies are part of the pedagogical technique known as active learning. Active learning is a strategy that became popular in the early 1990s and has proven itself as a valid tool for helping students to be engaged with learning. Methodology: This work follows a systematic method for identifying and coding previous research based on an aspect of interest. The authors identified and assessed research through a search of ABI/Inform scholarly journal abstracts and keywords, as well as additional research databases, using the search terms “active learning” and “information systems” from 2000 through June 2016. Contribution: This synthesis of active learning exercises provides guidance for information technology faculty looking to implement active learning strategies in their classroom by demonstrating how IS faculty might begin to introduce more active learning techniques in their teaching as well as by presenting a sample teaching agenda for a class that uses a mix of active and passive learning techniques to engage student learning. Findings: Twenty successful types of active learning exercises in IS courses are presented. Recommendations for Practitioners : This paper offers a “how to” resource of successful active learning strategies for IS faculty interested in implementing active learning in the classroom. Recommendation for Researchers: This work provides an example of a systematic literature review as a means to assess successful implementations of active learning in IS. Impact on Society: An updated definition of active learning is presented as well as a meaningful list of exercises that encourage active learning both inside and outside of the IS classroom. Future Research: In relation to future research, this study highlights a number of opportunities for IS faculty in regards to new active learning activities or trends to study further. Full Article
ea Advantages and Disadvantages of an Innovative Tablet Technology Learning Activity: A Ten Year Case Study in Small Tertiary Mathematics Classrooms By Published On :: 2019-01-17 Aim/Purpose: To identify positive and negative aspects for learning of interactive tablet technology learning activities that promote student engagement and learning. Background: Engaging students in mathematics classes is an on-going challenge for teachers. In 2008 we were offered the opportunity to run interactive activities with a class set of tablet PCs that had just been released on to the market. Since then, we have run these interactive activities continuously with mathematics classes for computing students, albeit with two changes in hardware. Methodology: In the interactive activities, students submit full worked solutions to various problem types (classified as table, text, open or multi-choice) which can then be displayed to the class anonymously, discussed and annotated by the teacher. We surveyed student and staff perceptions and monitored academic performance. Contribution: We have over 10 years of results, observations, and experience from 2008, when tablet technologies were new and expensive, to the current time, when modern tablets with styli are now affordable. Findings: There was a significant increase in higher grades although pass rates did not increase significantly. Over the ten year period of the study, perceptions of students and staff about how this technology impacted on student learning were consistently positive. The majority of students found all problem types useful for learning even those they rated “too hard” or “too easy”. Benefits included increased feedback, peer learning and engagement. Recommendations for Practitioners: We recommend using tablet learning activities to engage students and teachers and to contribute to learning. Impact on Society: This study shows how using tablet technologies for interactive classroom activities can enable and enhance known pedagogies of feedback, peer instruction, and student engagement for mathematics classes. Future Research: We recommend extending this study to include larger classes, and other technical subjects that use symbols and diagrams. In addition, we suggest considering control groups. Full Article
ea Investigating the Feasibility of Automatic Assessment of Programming Tasks By Published On :: 2018-11-24 Aim/Purpose: The aims of this study were to investigate the feasibility of automatic assessment of programming tasks and to compare manual assessment with automatic assessment in terms of the effect of the different assessment methods on the marks of the students. Background: Manual assessment of programs written by students can be tedious. The assistance of automatic assessment methods might possibly assist in reducing the assessment burden, but there may be drawbacks diminishing the benefits of applying automatic assessment. The paper reports on the experience of a lecturer trying to introduce automated grading. Students’ solutions to a practical Java programming test were assessed both manually and automatically and the lecturer tied the experience to the unified theory of acceptance and use of technology (UTAUT). Methodology: The participants were 226 first-year students registered for a Java programming course. Of the tests the participants submitted, 214 were assessed both manually and automatically. Various statistical methods were used to compare the manual assessment of student’s solutions with the automatic assessment of the same solutions. A detailed investigation of reasons for differences was also carried out. A further data collection method was the lecturer’s reflection on the feasibility of automatic assessment of programming tasks based on the UTAUT. Contribution: This study enhances the knowledge regarding benefits and drawbacks of automatic assessment of students’ programming tasks. The research contributes to the UTAUT by applying it in a context where it has hardly been used. Furthermore, the study is a confirmation of previous work stating that automatic assessment may be less reliable for students with lower marks, but more trustworthy for the high achieving students. Findings: An automatic assessment tool verifying functional correctness might be feasible for assessment of programs written during practical lab sessions but could be less useful for practical tests and exams where functional, conceptual and structural correctness should be evaluated. In addition, the researchers found that automatic assessment seemed to be more suitable for assessing high achieving students. Recommendations for Practitioners: This paper makes it clear that lecturers should know what assessment goals they want to achieve. The appropriate method of assessment should be chosen wisely. In addition, practitioners should be aware of the drawbacks of automatic assessment before choosing it. Recommendation for Researchers: This work serves as an example of how researchers can apply the UTAUT theory when conducting qualitative research in different contexts. Impact on Society: The study would be of interest to lecturers considering automated assessment. The two assessments used in the study are typical of the way grading takes place in practice and may help lecturers understand what could happen if they switch from manual to automatic assessment. Future Research: Investigate the feasibility of automatic assessment of students’ programming tasks in a practical lab environment while accounting for structural, functional and conceptual assessment goals. Full Article
ea Activity Oriented Teaching Strategy for Software Engineering Course: An Experience Report By Published On :: 2018-09-16 Aim/Purpose: This paper presents the findings of an Activity-Oriented Teaching Strategy (AOTS) conducted for a postgraduate level Software Engineering (SE) course with the aim of imparting meaningful software development experience for the students. The research question is framed as whether the activity-oriented teaching strategy helps students to acquire practical knowledge of Software Engineering and thus bridge the gap between academia and software industry. Background: Software Engineering Education (SEE) in India is mainly focused on teaching theoretical concepts rather than emphasizing on practical knowledge in software development process. It has been noticed that many students of CS/IT background are struggling when they start their career in the software industry due to inadequate familiarity with the software development process. In the current context of SE education, there is a knowledge gap between the theory learned in the classroom and the actual requirement demanded by the software industry. Methodology: The methodology opted for in this study was action research since the teachers are trying to solve the practical problems and deficiencies encountered while teaching SE. There are four pedagogies in AOTS for fulfilling the requirements of the desired teaching strategy. They are flipped classroom, project role-play for developing project artifacts, teaching by example, and student seminars. The study was conducted among a set of Postgraduate students of the Software Engineering programme at Cochin University of Science and Technology, India. Contribution: AOTS can fulfil both academic and industrial requirements by actively engaging the students in the learning process and thus helping them develop their professional skills. Findings: AOTS can be molded as a promising teaching strategy for learning Software Engineering. It focuses on the essential skill sets demanded by the software industry such as communication, problem-solving, teamwork, and understanding of the software development processes. Impact on Society: Activity-oriented teaching strategies can fulfil both academic and industrial requirements by actively engaging the students in the SE learning process and thus helping them in developing their professional skills. Future Research: AOTS can be refined by adding/modifying pedagogies and including different features like an online evaluation system, virtual classroom etc. Full Article
ea A Fully Online Research Portal for Research Students and Researchers By Published On :: 2018-08-06 Aim/Purpose: This paper describes the context, development, implementation, and the potential transferability of an integrated online research environment that allows its users to conduct all aspects of research online. Background: While the content of most traditional courses can be delivered online and learning outcomes can be achieved by adopting equivalents to face-to-face pedagogic approaches, certain courses, such as those that require a substantial research component, present significant constraints for delivery online. To overcome these limitations, Australia’s largest university developed and implemented a Research Portal. Methodology: The development team conducted a functional requirements analysis, identified the components that would be necessary to meet user needs, and reviewed existing solutions. The Monash University Psychology Research Portal was designed, tested, developed, tested for user experience, implemented, and reviewed. The Research Portal is structured according to the usual research sequence and provides users with access to supporting information and integrated capacities including research supervision, participant acquisition, and data collection, analysis, and storage. Contribution: This integrated online research environment is equivalent to and, in some ways, superior to an on campus/non-online research capacity. Findings: The usage of the Research Portal has grown rapidly and has satisfied the requirements and met the research needs of students of an online course that includes a research project, providing a common, ubiquitously accessible, and integrated online research environment. Recommendations for Practitioners: Further refinement, personalization, and expanded implementation and dissemination of the Research Portal components are required. The formation of networks and working partnerships to operate, maintain, and promote Research Portal initiatives is recommended to reduce operational costs, increase access, and create an impact. Impact on Society: The Research Portal is an efficient resource that provides easy access to a standard interface at any time and from anywhere and can potentially be used by other online research courses, as well as by online and non-online researchers. Full Article
ea The Impact of Teacher Gender on Girls’ Performance on Programming Tasks in Early Elementary School By Published On :: 2018-07-03 Aim/Purpose: The goal of this paper is to examine whether having female robotics teachers positively impacts girls’ performance on programming and robotics tasks Background: Women continue to be underrepresented in the technical STEM fields such as engineering and computer science. New programs and initiatives are needed to engage girls in STEM beginning in early childhood. The goal of this work is to explore the impact of teacher gender on young children’s mastery of programming concepts after completing an introductory robotics program. Methodology: A sample of N=105 children from six classrooms (2 Kindergarten, 2 first grade, and 2 second grade classes) from a public school in Somerville, Massachusetts, participated in this research. Children were taught the same robotics curriculum by either an all-male or all-female teaching team. Upon completion of the curriculum, they completed programming knowledge assessments called Solve-Its. Comparisons between the performance of boys and girls in each of the teaching groups were made. Findings: This paper provides preliminary evidence that having a female instructor may positively impact girls’ performance on certain programming tasks and reduce the number of gender differences between boys and girls in their mastery of programming concepts. Recommendations for Practitioners: Practitioners should expose children to STEM role-models from a variety of backgrounds, genders, ethnicities, and experiences. Future Research: Researchers should conduct future studies with larger samples of teachers in order to replicate the findings here. Additionally, future research should focus on collecting data from teachers in the form of interviews and surveys in order to find out more about gender-based differences in teaching style and mentorship and the impact of this on girls' interest and performance in STEM. Full Article
ea Delving into the Specificity of Instructional Guidance in Social Media-supported Learning Environments By Published On :: 2018-03-02 Aim/Purpose: This study investigates the variations in student participation patterns across different types of instructional activities, learning modes, and with different instructional guidance approaches. In the current study, different variables, modes of learning (guided versus unguided), and types of guidance (social versus cognitive) were manipulated in a series of microblogging-supported collaborative learning tasks to examine to what extent and in which aspects instructional guidance affects the effectiveness and student perception of microblogging-supported learning. Background: Despite the overwhelming agreement on the importance of instructional guidance in microblogging-supported learning environments, very few studies have been done to examine the specificity of guidance, such as how to structure and support microblogging activities, as well as what types of guidance are appropriate in what learning contexts. Methodology: This semester-long study utilized a case-study research design via a multi-dimensional approach in a hybrid classroom with both face-to-face and online environments. Tweets were collected from four types of activities and coded based on content within their contextual setting. Twenty-four college students participated in the study. Contribution: In response to the call to improve social media learning environments under-scored in contemporary education, the current case study took an initial step aiming at deepening the understanding of the role of instructional guidance in microblogging-supported learning environments. Findings: This study showcases that with instructor facilitation, students succeeded in being engaged in a highly participatory and interactive learning experience across a variety of tasks and activities. This study indicates that students’ perspectives of social media tools rely heavily on what instructors do with the tool and how the instructional activities are structured and supported. Instructors’ scaffolding and support is instrumental in keeping students on task and engaging students with meaningful events, thus ensuring the success of microblogging-based learning activities. Meanwhile, students’ perception of usefulness of instructional guidance is closely related to their own pre-perception and experience. Recommendations for Practitioners: When incorporating social media tools, it is important to examine learner’s prior knowledge and comfort level with these tools and tailor the design of instructional activities to their attributes. It is also vital to monitor student progress, adjust the type and amount of guidance and scaffolding provided as they progress, and eventually remove the scaffolding until students can demonstrate that they can perform the task successfully without assistance. Recommendation for Researchers: Due to many other potential factors in place that could potentially influence student learning, no conclusive remarks can be made regarding the superiority of either one type of guidance approach. Future researchers should continue to develop robust research methodologies to seek ways to better operationalize this variable and strive to understand its effect. Future Research: Future replication studies in other settings, with a larger sample size, and different populations will certainly provide further insights on the effects of instructional guidance in microblogging-based learning. Alternative coding methods may also shed light on differences in student interaction in terms of content diversity and depth of learning when analyzing the tweets. Advanced data collection techniques may be explored to ascertain the completeness of data collection. Full Article
ea A Real-time Plagiarism Detection Tool for Computer-based Assessments By Published On :: 2018-02-21 Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of policy driven and plagiarism detection approaches. These mechanisms are either proactive or reactive and focus on identifying, catching, and punishing those found to have cheated or plagiarized. To be more effective against plagiarism, mechanisms that detect cheating or colluding in real-time are desirable. Methodology: In the development of a tool for real-time plagiarism prevention, literature review and prototyping was used. The prototype was implemented in Delphi programming language using Indy components. Contribution: A real-time plagiarism detection tool suitable for use in a computer-based assessment setting is developed. This tool can be used to complement other existing mechanisms. Findings: The developed tool was tested in an environment with 55 personal computers and found to be effective in detecting unauthorized access to internet, intranet, and USB ports on the personal computers. Recommendations for Practitioners: The developed tool is suitable for use in any environment where computer-based evaluation may be conducted. Recommendation for Researchers: This work provides a set of criteria for developing a real-time plagiarism prevention tool for use in a computer-based assessment. Impact on Society: The developed tool prevents academic dishonesty during an assessment process, consequently, inculcating confidence in the assessment processes and respectability of the education system in the society. Future Research: As future work, we propose a comparison between our tool and other such tools for its performance and its features. In addition, we want to extend our work to include testing for scalability of the tool to larger settings. Full Article
ea Promising Instructional Practices for English Language Learners By Published On :: 2018-02-05 Aim/Purpose: The purpose of this exploratory case study was to understand how teachers, working with English Language Learners (ELLs), expanded their knowledge and instructional practices as they implemented a one-to-one iPad® program. Background: English Language Learners experience linguistic, cultural, and cognitive shifts that can be challenging, and at times lead to isolation for ELLs. While technology can be engaging, devices alone do not shift instructional practices, nor lead to student learning. Technology must be leveraged through shifts to pedagogical practice and linked thoughtfully to content goals. Methodology: This research was conducted through a qualitative case study of educators at an international school. Contribution: This study describes promising pedagogical practices for leveraging 1:1 mobile devices for ELLs. Findings: iPads can be a support for ELL students. One-to-one iPads allowed teachers to experiment with new pedagogical approaches, but this development varies greatly between teachers. During the 1:1 implementation there were challenges reported. Recommendations for Practitioners: In order to mitigate some of these challenges, and build on the success of this study, the researcher suggests developing a common vision for technology integration, using collaborative models of ELL teaching, and investing in professional development. Recommendation for Researchers: Researchers should continue to document and observe the learning outcomes of ELL students in 1:1 environments, including an experimental study. Impact on Society: ELLs can benefit from 1:1 technology, and new pedagogical practices. For teachers to implement these new practices conversations on philosophy, engagement with families, and consistent professional development. Future Research: Future research can continue to expand the population of ELL students in 1:1 mobile learning environments; and the most powerful pedagogical practices. Full Article
ea The Development of Computational Thinking in Student Teachers through an Intervention with Educational Robotics By Published On :: 2019-10-06 Aim/Purpose: This research aims to describe and demonstrate the results of an intervention through educational robotics to improve the computational thinking of student teachers. Background: Educational robotics has been increasing in school classrooms for the development of computational thinking and digital competence. However, there is a lack of research on how to prepare future teachers of Kindergarten and Elementary School in the didactic use of computational thinking, as part of their necessary digital teaching competence. Methodology: Following the Design-Based Research methodology, we designed an intervention with educational robots that includes unplugged, playing, making and remixing activities. Participating in this study were 114 Spanish university students of education. Contribution: This research helps to improve the initial training of student teachers, especially in the field of educational robotics. Findings: The student teachers consider themselves digital competent, especially in the dimensions related to social and multimedia aspects, and to a lesser extent in the technological dimension. The results obtained also confirm the effectiveness of the intervention through educational robotics in the development of computational thinking of these students, especially among male students. Recommendations for Practitioners: Teacher trainers could introduce robotics following these steps: (1) initiation and unplugged activities, (2) gamified activities of initiation to the programming and test of the robots, (3) initiation activities to Scratch, and (4) design and resolution of a challenge. Recommendation for Researchers: Researchers could examine how interventions with educational robots helps to improve the computational thinking of student teachers, and thoroughly analyze gender-differences. Impact on Society: Computational thinking and robotics are one of the emerging educational trends. Despite the rise of this issue, there are still few investigations that systematize and collect evidence in this regard. This study allows to visualize an educational intervention that favors the development of the computational thinking of student teachers. Future Research: Researchers could evaluate not only the computational thinking of student teachers, but also their didactics, their ability to teach or create didactic activities to develop computational thinking in their future students. Full Article
ea Computer Science Education in Early Childhood: The Case of ScratchJr By Published On :: 2019-10-01 Aim/Purpose: This paper aims to explore whether having state Computer Science standards in place will increase young children’s exposure to coding and powerful ideas from computer science in the early years. Background: Computer science education in the K-2 educational segment is receiving a growing amount of attention as national and state educational frameworks are emerging. By focusing on the app ScratchJr, the most popular free introductory block-based programming language for early childhood, this paper explores if there is a relationship between the presence of state frameworks and ScratchJr’s frequency of use. Methodology: This paper analyzes quantitative non-identifying data from Google Analytics on users of the ScratchJr programming app. Google Analytics is a free tool that allows access to user activity as it happens in real time on the app, as well as audience demographics and behavior. An analysis of trends by state, time of year, type of in-app activities completed, and more are analyzed with a specific focus on comparing states with K-12 Computer Science in place versus those without. Contribution: Results demonstrate the importance of having state standards in place to increase young children’s exposure to coding and powerful ideas from computer science in the early years. Moreover, we see preliminary evidence that states with Computer Science standards in place support skills like perseverance and debugging through ScratchJr. Findings: Findings show that in the case of ScratchJr, app usage decreases during the summer months and on weekends, which may indicate that coding with ScratchJr is more often happening in school than at home. Results also show that states with Computer Science standards have more ScratchJr users on average and have more total sessions with the app on average. Results also show preliminary evidence that states with Computer Science standards in place have longer average session duration as well as a higher average number of users returning to edit an existing project. Recommendations for Practitioners: Successful early childhood computer science education programs must teach powerful ideas from the discipline of computer science in a developmentally appropriate way, provide means for self-expression, prompt debugging and problem solving, and offer a low-floor/high-ceiling interface for both novices and experts. Practitioners should be aware in drops in computer science learning during the summer months when school is not in session. Recommendation for Researchers: Researchers should consider the impact of state and national frameworks on computer science learning and skills mastered during the early childhood years. Researchers should look for ways to continue engaging students in computer science education during times when school is not in session. Impact on Society: Results demonstrate the importance of having state CS standards in place to increase young children’s exposure to coding and powerful ideas from computer science in the early years. Moreover, we see preliminary evidence that states with Computer Science standards in place support skills like perseverance and debugging through ScratchJr. Future Research: Future research should continue collecting Google Analytics from the ScratchJr app and track changes in usage. Future research should also collect analytics from a wide range of programming applications for young children to see if the trends identified here are consistent across different apps. Full Article
ea Creatıng Infographics Based on the Bridge21 Model for Team-based and Technology-mediated Learning By Published On :: 2019-08-21 Aim/Purpose: The main aim of this study was modeling a collaborative process for knowledge visualization, via the creation of infographics. Background: As an effective method for visualizing complex information, creating infographics requires learners to generate and cultivate a deep knowledge of content and enables them to concisely visualize and share this knowledge. This study investigates creating infographics as a knowledge visualization process for collaborative learning situations by integrating the infographic design model into the team-based and technology-mediated Bridge21 learning model. Methodology: This study was carried out using an educational design perspective by conducting three main cycles comprised of three micro cycles: analysis and exploration; design and construction; evaluation and reflection. The process and the scaffolding were developed and enhanced from cycle to cycle based on both qualitative and quantitative methods by using the infographic design rubric and researcher observations acquired during implementation. Respectively, twenty-three, twenty-four, and twenty-four secondary school students participated in the infographic creation process cycles. Contribution: This research proposes an extensive step-by-step process model for creating infographics as a method of visualization for learning. It is particularly relevant for working with complex information, in that it enables collaborative knowledge construction and sharing of condensed knowledge. Findings: Creating infographics can be an effective method for collaborative learning situations by enabling knowledge construction, visualization and sharing. The Bridge21 activity model constituted the spine of the infographic creation process. The content generation, draft generation, and visual and digital design generation components of the infographic design model matched with the investigate, plan and create phases of the Bridge21 activity model respectively. Improvements on infographic design results from cycle to cycle suggest that the revisions on the process model succeeded in their aims. The rise in each category was found to be significant, but the advance in visual design generation was particularly large. Recommendations for Practitioners: The effectiveness of the creation process and the quality of the results can be boosted by using relevant activities based on learner prior knowledge and skills. While infographic creation can lead to a focus on visual elements, the importance of wording must be emphasized. Being a multidimensional process, groups need guidance to ensure effective collaboration. Recommendation for Researchers: The proposed collaborative infographic creation process could be structured and evaluated for online learning environments, which will improve interaction and achievement by enhancing collaborative knowledge creation. Impact on Society: In order to be knowledge constructors, innovative designers, creative communicators and global collaborators, learners need to be surrounded by adequate learning environments. The infographic creation process offers them a multidimensional learning situation. They must understand the problem, find an effective way to collect information, investigate their data, develop creative and innovative perspectives for visual design and be comfortable for using digital creation tools. Future Research: The infographic creation process could be investigated in terms of required learner prior knowledge and skills, and could be enhanced by developing pre-practices and scaffolding. Full Article
ea Changing the Learning Environment: Teachers and Students’ Collaboration in Creating Digital Games By Published On :: 2019-08-04 Aim/Purpose: The current study examines the impact of an intervention program to train teachers to collaborate with their students while creating digital games. Background: Teachers seem unable to leverage the potential of ICT to present students with a rich learning environment. ICT integration is usually at a relatively simple and concrete level without changing the traditional teacher-student paradigm. Methodology: The study is both quantitative and qualitative. Participants were 63 active teachers studying in the M.Ed. program at a teacher education college. The teachers responded to a series of pre- and post-questionnaires and wrote a concluding reflection. Contribution: Teaching based on creating digital games, combined with teacher-class collaboration, is a viable and real alternative of constructivist teaching, adapted to different learners. Findings: The SEM path analysis showed that it was only after the intervention that the lower the teachers’ resistance to changing teaching patterns, the higher their intrinsic motivation to learn an innovative pedagogical-technological program and likewise the sense of mastery of 21st-century skills, resulting in a positive attitude towards classroom collaboration. The qualitative findings reveal eight categories dealing with two main themes: the first is professional development, including conceptual, behavioral and emotional change, and the second is the teachers’ perception of the learners. Recommendations for Practitioners: Teacher training should be ongoing in order to change teaching-learning processes and promote an active approach based on constructive principles, 21st-century skills and collaboration between teachers and students in a computer environment. Recommendation for Researchers: Future studies should start by sampling teachers and education professionals who have convenient access to technology in their teaching-learning environment. Impact on Society: Collaboration between teachers and students in creating learning games in a computer environment and teacher-class collaboration, in general, require very different training than that which exists today. Hence there should be some rethinking of teacher training. The proposed pedagogical model is one such idea in the right direction. Future Research: A larger study with a greater number of participants, including a control group, should be conducted. Full Article
ea Enhancing Student Learning in Cybersecurity Education using an Out-of-class Learning Approach By Published On :: 2019-02-12 Aim/Purpose: In this study, the researchers investigated whether the out-of-class learning approach could help the students to attain any valuable learning outcomes for cybersecurity learning and could enhance the perceived value of cybersecurity education among the students. Background: Cybersecurity learning poses challenges for its students to learn a complicated subject matter and the students may be intimidated by the challenging courses in cybersecurity programs. Therefore, it is essential for the faculty members to devise some mechanisms to promote cybersecurity learning to increase its student retention. The mechanism suggested by this study was the out-of-class learning approach. Methodology: The researchers in this study employed a content analysis and adopted a semiotic method to analyze qualitative data. The researchers also conducted crosstabulation analyses using chi-square tests to detect the significant differences in the emerging learning outcomes from the two different out-of-class learning activities investigated in this study. Contribution: This study addressed the difficulty of cybersecurity education and proposed a viable mechanism to promote the student learning in such a complicated subject matter. Findings: For cybersecurity education, the out-of-class learning approach is a viable pedagogical mechanism that could lead the students to several learning outcomes, including connecting them to the real-life scenarios related to the cybersecurity profession, guiding them to their career choices and development, stimulating their intellectual growth, creating their justification of learning, and raising their cybersecurity awareness. Recommendations for Practitioners: The instructors of any cybersecurity programs should incorporate some out-of-class learning activities into the courses in their programs, especially the introductory-level courses. Additionally, it is important to coordinate the out-of-class learning activities with the in-class lessons to enable the students to justify what they have learned in their classrooms and motivate them to learn more. Recommendation for Researchers: Researchers could look beyond in-class learning and laboratory learning to investigate the impacts of out-of-class learning activities on cybersecurity education to help the students to attain better learning outcomes. Impact on Society: By promoting cybersecurity education, universities and colleges could attain a higher retention rate of the students in their cybersecurity programs. The higher retention rate of the students in cybersecurity programs would help to ease the critical shortage of cybersecurity talent. Future Research: Future research could explore the impacts of other out-of-class learning activities on cybersecurity learning; for example: job shadowing, attending cybersecurity conferences, internship, developing cybersecurity systems or tools for actual customers, working on cybersecurity research with faculty members. Additionally, future studies could investigate the effects of the out-of-class learning approach on promoting other academic programs that are characterized by intensely complex and technical nature, similar to cybersecurity programs. Full Article
ea Digital Literacy in Higher Education: A Case Study of Student Engagement with E-Tutorials Using Blended Learning By Published On :: 2019-01-28 Aim/Purpose: This paper reports on a case study project which had three goals; to develop a suite of original interactive digital skills e-tutorials to be embedded in undergraduate and postgraduate courses; to evaluate the students’ experience and engagement with the e-tutorials over one semester; and to explore their general attitudes towards online and blended learning. Background: Online and blended learning modes continue to grow in popularity in higher education, with the aim of streamlining and enhancing student learning, supporting collaboration and creativity, and equipping students with the skills they will require to work and live in an increasingly digitized world. This practice-based case study highlights factors which positively and negatively affect user engagement with digital learning objects and explores students’ perceptions of the role of online learning within their academic programs. Methodology: A suite of nine interactive e-tutorials, addressing essential digital literacy skills for university students, was developed through instructor and student peer collaboration using Articulate software, informed by best practice. The e-tutorials were embedded in the institutional Learning Management System for three undergraduate and postgraduate courses, in which digital literacy formed the core learning content, to complement classroom-based learning. Students in these courses were surveyed via SurveyMonkey about their specific experience of using the e-tutorials, as well as their general perceptions of digital literacy and online learning. Eighty-six students in total completed the questionnaire, which consisted of twenty-three closed- and open-ended questions. Contribution: Through highlighting both the positive and the challenging aspects of the students’ reported experience of online learning, this case study contributes useful insights to the body of literature on user engagement with digital learning objects in higher education, as well as students’ perceptions and experience of blended learning. Findings: The e-tutorials were perceived as valuable in reinforcing classroom learning, allowing respondents to revise concepts and materials covered in face-to-face classes, at their own pace and in their own time. Survey responses showed that the accessibility, ease-of-use, design and duration of the e-tutorials were deemed effective in terms of user engagement; however, several technological challenges were identified, such as browser incompatibility, uneven sound quality and general Internet connection issues, which disrupted their learning. Overall, students expressed enjoyment of the learning facilitated by the e-tutorials; however, rather than favoring online learning alone, they expressed a preference for a blended learning environment, with a combination of complementary learning approaches; survey respondents did not generally wish to forego face-to-face classes entirely. Recommendations for Practitioners: Instructors should seek to strategically embed interactive digital learning objects in their courses at defined points of need in a logical structure, e.g., to reinforce classroom-based learning, or to support specific skill development. Potential disruption to learning should be minimized by following best practice guidelines to ensure ease of access, a seamless user experience, and timely feedback, as well as providing adequate support for rapid resolution of technical glitches. Recommendation for Researchers: E-tutorials offer a useful means of exploring ways in which students acquire learning in the digital environment. A wider, collaborative exploration is needed to provide comparative studies which move beyond case studies. Impact on Society: Online learning mechanisms, such as e-tutorials, offer students different means of acquiring essential literacy skills and different ways to interact with content. E-tutorials constitute reusable learning objects, which can be accessed as just-in-time delivery modes, when students perceive they need to review particular skills or reinforce learning material. Future Research: This research is now expanding into different types of reusable learning objects. E-tutorials may be developed in multiple ways, and comparative research around e-tutorial models will deepen our understanding of how students interact with content in formal learning contexts. As the digital educational landscape continues to expand alongside traditional face-to-face and analogue learning modes, a key research focus will be student and instructor perceptions and experience of blended learning in different contexts. Full Article
ea Rubric for Measuring and Visualizing the Effects of Learning Computer Programming for Elementary School Students By Published On :: 2020-11-14 Aim/Purpose: Although many computer science measures have been proposed, visualizing individual students’ capabilities is difficult, as those measures often rely on specific tools and methods or are not graded. To solve these problems, we propose a rubric for measuring and visualizing the effects of learning computer programming for elementary school students enrolled in computer science education (CSE), which is independent of the programming language being used. Background: In this research, we proposed a rubric based on existing CSE standards and criteria having a programming education-learning goal. We then applied this rubric to actual lessons to visualize the educational effects. Methodology: The proposed new rubric for teaching computer programming, based on existing standards and criteria, was applied to fourth- and sixth-grade students in Japan. We assessed which skills were cultivated through quizzes before and after the teaching. Contribution: This paper contributes on how to make and utilize a rubric for programming education in computer science. We evaluated and visualized the proposed rubric’s learning effects on children and found that our proposed rubrics are independent of any particular method or tool. Findings: The results of this survey are twofold: (1) we proposed a rubric of programming education in computer science, independent of the programming tools used and (2) we succeeded in visualizing students’ learning stages by applying the proposed rubric to programming education conducted in a Japanese elementary school. Recommendations for Practitioners: Evaluating educational effects in CSE is important. In particular, graded assessments of learner abilities can reveal individual characteristics. This research is useful for assessing CSE because it focuses specifically on programming education. Recommendation for Researchers: The rubric’s suggestions and quality improvements in CSE help learners assess their learning progress and will clarify the cultivated computer science skills. Impact on Society: This research evaluates CSE based on a rubric in the programming education field. Future Research: Future work is needed to improve the proposed rubric’s quality and relevance. Also, this rubric should be applied to many classes to increase the number of evaluations and analyses. Full Article
ea Students’ Awareness and Embracement of Soft Skills by Learning and Practicing Teamwork By Published On :: 2020-10-18 Aim/Purpose: This paper presents a study about changes in computer science and software engineering students’ perceptions of their soft skills during their progress through the Computer Science Soft Skills course. Background: Soft skills are often associated with a person’s social, emotional and cognitive capabilities. Soft skills are increasingly sought out and are well recognized by employers alongside standard qualifications. Therefore, high importance is attributed to soft skills in computer science and software engineering education. Methodology: Content analysis was applied to interpret, categorize and code statements from students’ course assignment answers. Data analysis was performed gradually at the three main stages of the course and by the two students’ study populations. Contribution: The paper highlights the variety of (a) soft skills that can be learnt in one course, both on the individual level and on the team level and (b) assignments that can be given to students to increase their awareness and motivation to practice and learn soft skills. Findings: Data analysis revealed the following: (a) five individual soft skills categories, with 95 skills, and five team-related soft skills categories, with 52 skills (in total, the students mentioned 147 soft skills); (b) course assignments and particularly team-based activities elicited student awareness of their individual soft skills, both as strengths and weaknesses; (c) students developed their reflection skills, particularly with respect to team-related soft skills; and (d) significant differences exist between the two groups of students in several categories. Recommendations for Practitioners: It is important to provide undergraduate students with opportunities to integrate soft skills during their training. Establishing a meaningful learning process, such as project-based learning, enables students to apply and develop soft skills when accompanied by reflective thought processes. Recommendation for Researchers: A similar course can be taught and be accompanied by similar analysis of students’ learning outcomes, to examine the influence of local culture on the characteristics of soft skills. Impact on Society: Increased awareness of soft skills in scientists and engineers’ undergraduate education. University graduates who will strengthen their variety of soft skills in their academic training process and will be more meaningful employees in the workplace and in society. Future Research: Our future research aims (a) to explore additional innovative ways to increase students’ learning processes, awareness and practices in relation to soft skills and (b) to research how students’ soft skills are developed during the entire undergraduate studies both on the individual level and the team level. Full Article
ea A Study on the Effectiveness of an Undergraduate Online Teaching Laboratory With Semantic Mechanism From a Student Perspective By Published On :: 2020-08-30 Aim/Purpose: The current study was conducted to investigate the students’ perceived satisfaction with the use of a semantic-based online laboratory, which provides students with a search mechanism for laboratory resources, such as instruments and devices. Background: The increasing popularity of using online teaching labs, as an important element of experiential learning in STEM education, is because they represent a collection of integrated tools that allow students and teachers to interact and work collaboratively, whereas they provide an enriched learning content delivery mechanism. Moreover, several research studies have proposed various approaches for online teaching laboratories. However, there are hardly any studies that examine the student satisfaction provided by online laboratories based on students’ experiential learning. Methodology: To measure the effectiveness of the laboratory, we performed a case study in a Computer Fundamentals online course in which undergraduate students were able to manage devices and instruments remotely. Participants were a sample of 50 third semester students of Bachelor’s degree in Information Technology Administration who were divided in experimental and control groups (online laboratory vs. traditional manner). Given a laboratory assignment, students were able to carry out the management of devices and instruments through a LabView virtual environment and web services. The data of the experiment were collected through two questionnaires from both groups. The first is a system usability score (SUS) questionnaire concerning lab usability and the second one students’ cognitive load. Contribution: The results of the study showed a high correlation between usability and cognitive load-satisfaction of students who used the online teaching laboratory compared to the students who did not use it. Findings: On the one hand, the online laboratory provided students with an easy way to share and deploy instruments and devices, thus enhancing system usability. On the other hand, it offered important facilities which enabled students to customize the search for instruments and devices, which certainly had a positive impact on the relationship between cognitive load and satisfaction. Recommendations for Practitioners: In this work we propose an intuitive laboratory interface as well as easiness to use but challenging and capable of providing similar experiences to the traditional laboratory. Recommendation for Researchers: This study is one of the first to analyze the cognitive load-satisfaction relationship and compare it with usability scores. Impact on Society: Our analyses make an important contribution to the literature by suggesting a correlation analysis comparing the results of experimental and control groups that participated in this research work, in terms of usability and cognitive load-satisfaction. Future Research: Future work will also investigate other methodological aspects of instructional design with the aim to improve personalized learning and reinforce collaborative experiences, as well as to deal with problems related to laboratory access, such as authentication, scheduling, and interoperability. Full Article
ea Redesigning an Introductory Programming Course to Facilitate Effective Student Learning: A Case Study By Published On :: 2020-08-28 Aim/Purpose: This study reports the outcome of how a first pilot semester introductory programming course was designed to provide tangible evidence in support of the concept of Student Ownership of Learning (SOL) and how the outcomes of this programming course facilitate effective student learning. Background: Many instructors want to create or redesign their courses to strengthen the relationship between teaching and learning; however, the researchers of this study believe that the concept of Student Ownership of Learning (SOL) connects to student engagement and achievement in the classroom setting. The researchers redesigned the introductory programming course to include valuable teaching methods to increase Student Ownership of Learning and constructive approaches such as making students design an authentic mobile app project as individuals, partners, or within teams. The high quality of students’ projects positioned them as consultants to the university IT department. Methodology: This paper employs a case study design to construct a qualitative research method as it relates to the phenomenon of the study’s goals and lived experiences of students in the redesigned introductory programming course. The redesigned course was marketed to students as a new course with detailed description and elements that were different from the traditional computer science introductory programming course requirement. The redesigned introductory programming course was offered in two sections: one section with 14 registered students and the other section with 15 registered students. One faculty member instructed both sections of the course. A total of 29 students signed up for the newly redesigned introductory programming course, more than in previous semesters, but two students dropped out within the first two weeks of the redesigned course making a total of 27 students. The redesigned coursework was divided into two parts of the semester. The first part of the semester detailed description and elements of the coursework including a redesigned approach with preparation for class, a quiz, and doing homework in class, which gives students control of decisions whenever possible; and working with each other, either with a partner or in a team. The second part of the semester focuses on students designing a non-trivial working mobile app and presenting their developing mobile app at a significant public competition at the end of the semester. Students developed significantly complex mobile apps and incorporated more complex functionality in their apps. Both Management Information System (MIS) major students and Computer Science major students were in the same course despite the fact that MIS students had never taken a programming course before; however, the Computer Science students had taken at least one course of programming. Contribution: This study provides a practical guide for faculty members in Information Technology programs and other faculty members in non-Computer Science programs to create or redesign an introductory course that increases student engagement and achievement in the classroom based on the concept of Student Ownership of Learning (SOL). This study also deepens the discussion in curriculum and instruction on the value to explore issues that departments or programs should consider when establishing coursework or academic programs. Findings: This study found two goals evidently in support to increase Student Ownership of Learning (SOL). The first goal (Increase their ownership of learning SOL) showed that students found value in the course contents and took control of their learning; therefore, the faculty no longer had to point out how important different programming concepts were. The students recognized their own learning gap and were excited when shown a programming concept that addressed the gap. For example, student comments were met with “boy, we can really use this in our app” instead of comments about how complex they were. The coursework produced a desired outcome for students as they would get the knowledge needed to make the best app that they could. The second goal (Develop a positive attitude toward the course) showed positive results as students developed a more positive attitude towards the course. Student actions in the classroom strongly reflected a positive attitude. Attendance was almost 100% during the semester even though no points for attendance were given. Further evidence of Student Ownership of Learning and self-identity was students’ extensive use of the terminology and concept of the course when talking to others, especially during the public competition. Students were also incorporating their learning into their identities. For example, teams became known by their app such as the Game team, the Recipe team, and the Parking team. One team even made team t-shirts. Another exciting reflection of the Student Ownership of Learning which occurred was the learning students did by themselves. Recommendations for Practitioners: Practitioners can share best practices with faculty in different departments, programs, universities, and educational consultants to cultivate the best solution for Student Ownership of Learning based on student engagement and achievement in the classroom setting. Recommendation for Researchers: Researchers can explore different perspectives with scholars and practitioners in various disciplinary fields of study to create or redesign courses and programs to reflect Student Ownership of Learning (SOL). Impact on Society: Student Ownership of Learning is relevant for faculty and universities to incorporate in the creation or redesigning of coursework in academic programs. Readers can gain an understanding that student engagement and achievement are two important drivers of Student Ownership of Learning (SOL) in the classroom setting. Future Research: Practitioners and researchers could follow-up in the future with a study to provide more understanding and updated research information from different research samples and hypotheses on Student Ownership of Learning (SOL). Full Article
ea Novice Programmers’ Coping with Multi-Threaded Software Design By Published On :: 2020-07-25 Aim/Purpose: Multi-threaded software design is considered to be difficult, especially to novice programmers. In this study, we explored how students cope with a task that its solution requires a multi-threaded architecture to achieve optimal runtime. Background: An efficient exploit of multicore processors architecture requires computer programs that use parallel programming techniques. However, parallel programming is difficult to understand and apply by novice programmers. Methodology: The students had to address a two-stage problem: (1) design an optimal runtime solution to a given problem with no additional instructions; and (2) provide an optimal runtime multi-threaded design to the same problem. Interviews were conducted with a representative group of students to understand the underlying causes of their provided designs. We used qualitative research methods to gain refined insights regarding the students’ decision making during the design process. To analyze the gained data, we used content analysis tools. Contribution: The case study presented in this paper will help the teacher to stress the merits and limitations of various parallel architectures and confront students with the consequences of their solutions via performances’ benchmark. Findings: Analysis of the student’s solutions to the first stage revealed that the majority of them did not provide a multi-threaded solution ignoring the optimal runtime requirement. At the second stage, seven various architectures were provided differing in the number of involved threads, the data structures used, and the synchronization mechanism employed. The majority of the solutions were sub-optimal and only a few students provided an optimal one. Recommendations for Practitioners: We recommend conducting class discussions that will follow a task similar to the one used in this study. Recommendation for Researchers: To be able to generalize the received results this research should be repeated with larger study participant groups from various academic institutions. Impact on Society: Understanding the difficulties of novice programmers may lead to quality software systems. Future Research: To be able to generalize the received results this research should be repeated with larger study participant groups from various academic institutions. Full Article
ea Incorporating Kinesthetic Learning into University Classrooms: An Example from Management Information Systems By Published On :: 2020-03-27 Aim/Purpose: Students tend to learn best when an array of learning styles is used by instructors. The purpose of this paper is to add, to introduce, and to apply the concepts of kinesthetic learning and learning structures to university and STEM education. Background: The study applies the concept of kinesthetic learning and a learning structure called Think-Pair-Share to an experiential exercise about Moore’s Law in an introductory MIS classroom. The paper details the exercise and each of its components. Methodology: Students in two classes were asked to complete a short survey about their conceptual understanding of the course material before and after the experiential exercise. Contribution: The paper details the benefits of kinesthetic learning and learning structures and discusses how to apply these concepts through an experiential exercise used in an introductory MIS course. Findings: Results indicate that the kinesthetic learning activity had a positive impact on student learning outcomes. Recommendations for Practitioners: University educators can use this example to structure several other learning activities that apply kinesthetic learning principles. Recommendation for Researchers: Researchers can use this paper to study more about how to incorporate kinesthetic learning into education, and about teaching technology concepts to undergraduate students through kinesthetic learning. Impact on Society: The results of this study may be extremely beneficial for the university and STEM community and overall academic business community. Future Research: Researchers should consider longitudinal studies and other ways to incorporate kinesthetic learning activities into education. Full Article
ea E- Assessment with Multiple-Choice Questions: A 5 Year Study of Students’ Opinions and Experience By Published On :: 2020-01-24 Aim/Purpose: The aim of this study is to understand student’s opinions and perceptions about e-assessment when the assessment process was changed from the traditional computer assisted method to a multiple-choice Moodle based method. Background: In order to implement continuous assessment to a large number of students, several shifts are necessary, which implies as many different tests as the number of shifts required. Consequently, it is difficult to ensure homogeneity through the different tests and a huge amount of grading time is needed. These problems related to the traditional assessment based on computer assisted tests, lead to a re-design of the assessment resulting in the use of multiple-choice Moodle tests. Methodology: A longitudinal, concurrent, mixed method study was implemented over a five-year period. A survey was developed and carried out by 815 undergraduate students who experienced the electronic multiple-choice questions (eMCQ) assessment in the courses of the IS department. Qualitative analyses included open-ended survey responses and interviews with repeating students in the first year. Contribution: This study provides a reflection tool on how to incorporate frequent moments of assessment in courses with a high number of students without overloading teachers with a huge workload. The research analysed the efficiency of assessing non-theoretical topics using eMCQ, while ensuring the homogeneity of assessment tests, which needs to be complemented with other assessment methods in order to assure that students develop and acquire the expected skills and competencies. Findings: The students involved in the study appreciate the online multiple-choice quiz assessment method and perceive it as fair but have a contradictory opinion regarding the preference of the assessment method, throughout the years. These changes in perception may be related to the improvement of the question bank and categorisation of questions according to difficulty level, which lead to the nullification of the ‘luck factor’. Other major findings are that although the online multiple-choice quizzes are used with success in the assessment of theoretical topics, the same is not in evidence regarding practical topics. Therefore, this assessment needs to be complemented with other methods in order to achieve the expected learning outcomes. Recommendations for Practitioners: In order to be able to evaluate the same expected learning outcomes in practical topics, particularly in technology and information systems subjects, the evaluator should complement the online multiple-choice quiz assessment with other approaches, such as a PBL method, homework assignments, and/or other tasks performed during the semester. Recommendation for Researchers: This study explores e-assessment with online multiple-choice quizzes in higher education. It provides a survey that can be applied in other institutions that are also using online multiple-choice quizzes to assess non-theorical topics. In order to better understand the students’ opinions on the development of skills and competencies with online multiple-choice quizzes and on the other hand with classical computer assisted assessment, it would be necessary to add questions concerning these aspects. It would then be interesting to compare the findings of this study with the results from other institutions. Impact on Society: The increasing number of students in higher education has led to a raised use of e-assessment activities, since it can provide a fast and efficient manner to assess a high number of students. Therefore, this research provides meaningful insight of the stakeholders’ perceptions of online multiple-choice quizzes about practical topics. Future Research: An interesting study, in the future, would be to obtain the opinions of a particular set of students on two tests, one of the tests using online multiple-choice quizzes and the other through a classical computer assisted assessment method. A natural extension of the present study is a comparative analysis regarding the grades obtained by students who performed one or another type of assessment (online multiple-choice quizzes vs. classical computer assisted assessment). Full Article
ea Using Educational Data Mining to Predict Students’ Academic Performance for Applying Early Interventions By Published On :: 2021-07-23 Aim/Purpose: One of the main objectives of higher education institutions is to provide a high-quality education to their students and reduce dropout rates. This can be achieved by predicting students’ academic achievement early using Educational Data Mining (EDM). This study aims to predict students’ final grades and identify honorary students at an early stage. Background: EDM research has emerged as an exciting research area, which can unfold valuable knowledge from educational databases for many purposes, such as identifying the dropouts and students who need special attention and discovering honorary students for allocating scholarships. Methodology: In this work, we have collected 300 undergraduate students’ records from three departments of a Computer and Information Science College at a university located in Saudi Arabia. We compared the performance of six data mining methods in predicting academic achievement. Those methods are C4.5, Simple CART, LADTree, Naïve Bayes, Bayes Net with ADTree, and Random Forest. Contribution: We tested the significance of correlation attribute predictors using four different methods. We found 9 out of 18 proposed features with a significant correlation for predicting students’ academic achievement after their 4th semester. Those features are student GPA during the first four semesters, the number of failed courses during the first four semesters, and the grades of three core courses, i.e., database fundamentals, programming language (1), and computer network fundamentals. Findings: The empirical results show the following: (i) the main features that can predict students’ academic achievement are the student GPA during the first four semesters, the number of failed courses during the first four semesters, and the grades of three core courses; (ii) Naïve Bayes classifier performed better than Tree-based Models in predicting students’ academic achievement in general, however, Random Forest outperformed Naïve Bayes in predicting honorary students; (iii) English language skills do not play an essential role in students’ success at the college of Computer and Information Sciences; and (iv) studying an orientation year does not contribute to students’ success. Recommendations for Practitioners: We would recommend instructors to consider using EDM in predicting students’ academic achievement and benefit from that in customizing students’ learning experience based on their different needs. Recommendation for Researchers: We would highly endorse that researchers apply more EDM studies across various universities and compare between them. For example, future research could investigate the effects of offering tutoring sessions for students who fail core courses in their first semesters, examine the role of language skills in social science programs, and examine the role of the orientation year in other programs. Impact on Society: The prediction of academic performance can help both teachers and students in many ways. It also enables the early discovery of honorary students. Thus, well-deserved opportunities can be offered; for example, scholarships, internships, and workshops. It can also help identify students who require special attention to take an appropriate intervention at the earliest stage possible. Moreover, instructors can be aware of each student’s capability and customize the teaching tasks based on students’ needs. Future Research: For future work, the experiment can be repeated with a larger dataset. It could also be extended with more distinctive attributes to reach more accurate results that are useful for improving the students’ learning outcomes. Moreover, experiments could be done using other data mining algorithms to get a broader approach and more valuable and accurate outputs. Full Article
ea The Effect of E-Learning Experience on Readiness, Attitude, and Self-Control/Self-Management By Published On :: 2021-07-20 Aim/Purpose: This study aimed to reveal the effect of the previous Internet-based education (IBE) experiences of the students’ readiness, attitude, and self-control / self-management variables towards the e-learning process, and also to determine their opinions. Background: The institutions have made efforts to ensure the continuity of education through their learning management systems and the necessity of addressing the e-learning process from the perspective of students once again showed itself as an undeniable fact. Accordingly, the necessity to consider holistically the variables of readiness, attitude, and self-control/self-management, which affect students’ adaptation to e-learning process, has once again emerged based on the relevant literature. Methodology: This research based on the simultaneous mixed method considering the previous IBE experiences of 75 Computer Education and Instructional Technology (CEIT) students taking part in the study in Turkey. The quantitative results of the study were analyzed based on the single-group pretest-posttest weak experimental design. Qualitative results were obtained through the structured interview form and set an example for the case study. Contribution: The results showed that regardless of students’ previous Internet-based education (IBE) experience, it is seen that increasing and continuous experience has a significant effect on the readiness, attitude and self-control / self-management variables towards the e-learning process. The main contribution of experimental results showed that IBE experience is effective on individuals’ perceptions of internet self-efficacy, and has an impact on the self-learning skills of individuals. In addition to this, the e-learning experience has an impact on individuals’ self-evaluation. It is also seen that the certificate presented to learners in the e-learning environment has a positive effect on students’ attitudes towards e-learning processes. Finally, the experiences of e-learning processes, the methods used to transfer the content in the learning environment, the motivation and feedback provided to the learner also support the significant difference obtained in terms of readiness, attitude and self-control / self-management. Findings: After the findings were analyzed holistically in depth, it has been observed that; if the contents offered to students in e-learning environments support their professional development, in this case, their attitudes, readiness (excluding the sub-dimension of learner control), and self-control/self-management skills for these environments differ significantly in the posttest. It is also among the results that students having previous IBE experience have not higher awareness levels on online communication self-efficacy, technology use self-efficacy, readiness for e-learning, e-learning predisposition, self-reinforcement, self-control management, although significantly found. The findings regarding the effectiveness of the experimental process are as follows: Although it is possible for the students having previous IBE experience to use these experiences within the course for their personal development, it has been seen that the observed differences regarding students’ readiness, attitude, and self-control/self-management towards e-learning processes arise from the experimental operation. Recommendations for Practitioners: It is recommended for the policy-makers and practitioners that while e-learning platforms were designing, using different methods for delivering the content is as important as making the interaction meaningful and sustainable. In addition to this, to develop a positive attitude it is recommended that individuals’ participation of an e-learning platform should be supported with a certificate. Recommendation for Researchers: Researchers should test the obtained results by a well-structured e-learning platform with their recorded activities on the platform (e.g. in which section was used mostly by a learner etc.). Hence, the impact of IBE experiences might be discussed in an up level framework. Impact on Society: Actually, this study is based on a mix design and the results were also meaningful especially considering the implacable global pandemic. It is clearly understood by this process that e-learning is very important. In line with this, to support the e-learning process (e.g. with the method while delivering the content, well-structured feedback, motivation strategies etc.) and make it sustainable, the increasing of individual’s readiness, attitude, and self-control through the IBE would be indispensable. Future Research: Future studies might focus on the longitudinal methods. It is worth to find out how the students experiences affect the sustainability of the course content, and what should the program developer make to improve their course content in line with the findings of longitudinal studies. Full Article
ea Towards Understanding Information Systems Students’ Experience of Learning Introductory Programming: A Phenomenographic Approach By Published On :: 2021-07-12 Aim/Purpose: This study seeks to understand the various ways information systems (IS) students experience introductory programming to inform IS educators on effective pedagogical approaches to teaching programming. Background: Many students who choose to major in information systems (IS), enter university with little or no experience of learning programming. Few studies have dealt with students’ learning to program in the business faculty, who do not necessarily have the computer science goal of programming. It has been shown that undergraduate IS students struggle with programming. Methodology: The qualitative approach was used in this study to determine students’ notions of learning to program and to determine their cognitive processes while learning to program in higher education. A cohort of 47 students, who were majoring in Information Systems within the Bachelor of Commerce degree programme were part of the study. Reflective journals were used to allow students to record their experiences and to study in-depth their insights and experiences of learning to program during the course. Using phenomenographic methods, categories of description that uniquely characterises the various ways IS students experience learning to program were determined. Contribution: This paper provides educators with empirical evidence on IS students’ experiences of learning to program, which play a crucial role in informing IS educators on how they can lend support and modify their pedagogical approach to teach programming to students who do not necessarily need to have the computer science goal of programming. This study contributes additional evidence that suggests more categories of description for IS students within a business degree. It provides valuable pedagogical insights for IS educators, thus contributing to the body of knowledge Findings: The findings of this study reveal six ways in which IS students’ experience the phenomenon, learning to program. These ways, referred to categories of description, formed an outcome space. Recommendations for Practitioners: Use the experiences of students identified in this study to determine approach to teaching and tasks or assessments assigned Recommendation for Researchers: Using phenomenographic methods researchers in IS or IT may determine pedagogical content knowledge in teaching specific aspects of IT or IS. Impact on Society: More business students would be able to program and improve their logical thinking and coding skills. Future Research: Implement the recommendations for practice and evaluate the students’ performance. Full Article
ea A Cognitive Approach to Assessing the Materials in Problem-Based Learning Environments By Published On :: 2021-07-12 Aim/Purpose: The purpose of this paper is to develop and evaluate a debiasing-based approach to assessing the learning materials in problem-based learning (PBL) environments. Background: Research in cognitive debiasing suggests nine debiasing strategies improve decision-making. Given the large number of decisions made in semester-long, problem-based learning projects, multiple tools and techniques help students make decisions. However, instructors may struggle to identify the specific tools or techniques that could be modified to best improve students’ decision-making in the project. Furthermore, a structured approach for identifying these modifications is lacking. Such an approach would match the debiasing strategies with the tools and techniques. Methodology: This debiasing framework for the PBL environment is developed through a study of debiasing literature and applied within an e-commerce course using the Model for Improvement, continuous improvement process, as an illustrative case to show its potential. In addition, a survey of the students, archival information, and participant observation provided feedback on the debiasing framework and its ability to assess the tools and techniques within the PBL environment. Contribution: This paper demonstrates how debiasing theory can be used within a continuous improvement process for PBL courses. By focusing on a cognitive debiasing-based approach, this debiasing framework helps instructors 1) identify what tools and techniques to change in an PBL environment, and 2) assess which tools and techniques failed to debias the students adequately, providing potential changes for future cycles. Findings: Using the debiasing framework in an e-commerce course with significant PBL elements provides evidence that this framework can be used within IS courses and more broadly. In this particular case, the change identified in a prior cycle proved effective and additional issues were identified for improvement. Recommendations for Practitioners: With the growing usage of semester-long PBL projects in business schools, instructors need to ensure that their design of the projects incorporates techniques that improve student learning and decision making. This approach provides a means for assessing the quality of that design. Recommendation for Researchers: This study uses debiasing theory to improve course techniques. Researchers interested in assessment, course improvement, and program improvement should incorporate debiasing theory within PBL environments or other types of decision-making scenarios. Impact on Society: Increased awareness of cognitive biases can help instructors, students, and professionals make better decisions and recommendations. By developing a framework for evaluating cognitive debiasing strategies, we help instructors improve projects that prepare students for complex and multifaceted real-world projects. Future Research: The approach could be applied to multiple contexts, within other courses, and more widely within information systems to extend this research. The framework might also be refined to make it more concise, integrated with assessment, or usable in more contexts. Full Article
ea Innovative Pedagogical Strategies of Streaming, Just-in-Time Teaching, and Scaffolding: A Case Study of Using Videos to Add Business Analytics Instruction Across a Curriculum By Published On :: 2021-01-29 Aim/Purpose: Business analytics is a cross-functional field that is important to implement for a college and has emerged as a critically important core component of the business curriculum. It is a difficult task due to scheduling concerns and limits to faculty and student resources. This paper describes the process of creating a central video repository to serve as a platform for just in time teaching and the impact on student learning outcomes. Background: Industry demand for employees with analytical knowledge, skills, and abilities requires additional analytical content throughout the college of business curriculum. This demand needs other content to be added to ensure that students have the prerequisite skills to complete assignments. Two pedagogical approaches to address this issue are Just-in-Time Teaching (JiTT) and scaffolding, grounded in the Vygoskian concept of “Zone of Proximal Development. Methodology: This paper presents a case study that applies scaffolding and JiTT teaching to create a video repository to add business analytics instruction to a curriculum. The California Critical Thinking Skills Test (CCTST) and Major Field Test (MFT) scores were analyzed to assess learning outcomes. Student and faculty comments were considered to inform the results of the review. Contribution: This paper demonstrates a practical application of scaffolding and JiTT theory by outlining the process of using a video library to provide valuable instructional resources that support meaningful learning, promote student academic achievement, and improve program flexibility. Findings: A centrally created library is a simple and inexpensive way to provide business analytics course content, augmenting standard content delivery. Assessment of learning scores showed an improvement, and a summary of lessons learned is provided to guide implications. Recommendations for Practitioners: Pedagogical implications of this research include the observation that producing a central library of instructor created videos and assignments can help address knowledge and skills gaps, augment the learning of business analytics content, and provide a valuable educational resource throughout the college of business curriculum. Recommendation for Researchers: This paper examines the use of scaffolding and JiTT theories. Additional examination of these theories may improve the understanding and limits of these concepts as higher education evolves due to the combination of market forces changing the execution of course delivery. Impact on Society: Universities are tasked with providing new and increasing skills to students while controlling the costs. A centrally created library of instructional videos provides a means of delivering meaningful content while controlling costs. Future Research: Future research may examine student success, including the immediate impact of videos and longitudinally using video repositories throughout the curriculum. Studies examining the approach across multiple institutions may help to evaluate the success of video repositories. Faculty acceptance of centrally created video libraries and assignments should be considered for the value of faculty recruiting and use in the classroom. The economic impact on both the university and students should be evaluated. Full Article
ea Knowledge Management Applied to Learning English as a Second Language Through Asynchronous Online Instructional Videos By Published On :: 2022-09-14 Aim/Purpose: The purpose of this research is to determine whether ESL teaching videos as a form of asynchronous online knowledge sharing can act as an aid to ESL learners internalizing knowledge in language acquisition. In this context, internalizing knowledge carries the meaning of being able to remember language, and purposefully and accurately use it context, including appropriacy of language, and aspects of correct pronunciation, intonation, stress patterns and connected speech, these being the elements of teaching and practice that are very often lacking in asynchronous, online, instructional video. Background: Knowledge Management is the field of study, and the practice, of discovering, capturing, sharing, and applying knowledge, typically with a view to translating individuals’ knowledge into organizational knowledge. In the field of education, it is the sharing of instructors’ knowledge for students to be able to learn and usefully apply that knowledge. In recent pandemic times, however, the mode of instruction has, of necessity, transitioned from face-to-face learning to an online environment, transforming the face of education as we know it. While this mode of instruction and knowledge sharing has many advantages for the online learner, in both synchronous and asynchronous learning environments, it presents certain challenges for language learners due to the absence of interaction and corrective feedback that needs to take place for learners of English as a Second Language (ESL) to master language acquisition. Unlike other subjects where the learner has recourse to online resources to reinforce learning through referencing external information, such as facts, figures, or theories, to be successful in learning a second language, the ESL learner needs to be able to learn to process thought and speech in that language; essentially, they need to learn to think in another language, which takes time and practice. Methodology: The research employs a systematic literature review (SLR) to determine the scope and extent to which the subject is covered by existing research in this field, and the findings thereof. Contribution: Whilst inconclusive in relation to internalizing language through online, asynchronous instructional video, through its exploratory nature, the research contributes towards the body of knowledge in online learning through the drawing together of various studies in the field of learning through asynchronous video through improving video and instructional quality. Findings: The findings of the systematic literature review revealed that there is negligible research in this area, and while information exists on blended and flipped modes of online learning, and ways to improve the quality and delivery of instructional video generally, no prior research on the exclusive use of asynchronous videos as an aid to internalizing English as a second language were found. Recommendations for Practitioners: From this research, it is apparent that there is considerably more that practitioners can do to improve the quality of instructional videos that can help students engage with the learning, from which students stand a much better chance of internalizing the learning. Recommendation for Researchers: For researchers, the absence of existing research is an exciting opportunity to further explore this field. Impact on Society: Online learning is now globally endemic, but it poses specific challenges in the field of second language learning, so the development of instructional videos that can facilitate this represents a clear benefit to all ESL learners in society as a whole. Future Research: Clearly the absence of existing research into whether online asynchronous instructional videos can act as an aid to internalizing the acquisition of English as a second language would indicate that this very specific field is one that merits future research. Indeed, it is one that the author intends to exploit through primary data collection from the production of a series of asynchronous, online, instructional videos. Full Article
ea A Deep Learning Based Model to Assist Blind People in Their Navigation By Published On :: 2022-08-23 Aim/Purpose: This paper proposes a new approach to developing a deep learning-based prototyping wearable model which can assist blind and visually disabled people to recognize their environments and navigate through them. As a result, visually impaired people will be able to manage day-to-day activities and navigate through the world around them more easily. Background: In recent decades, the development of navigational devices has posed challenges for researchers to design smart guidance systems for visually impaired and blind individuals in navigating through known or unknown environments. Efforts need to be made to analyze the existing research from a historical perspective. Early studies of electronic travel aids should be integrated with the use of assistive technology-based artificial vision models for visually impaired persons. Methodology: This paper is an advancement of our previous research work, where we performed a sensor-based navigation system. In this research, the navigation of the visually disabled person is carried out with a vision-based 3D-designed wearable model and a vision-based smart stick. The wearable model used a neural network-based You Only Look Once (YOLO) algorithm to detect the course of the navigational path which is augmented by a GPS-based smart Stick. Over 100 images of each of the three classes, namely straight path, left path and right path, are being trained using supervised learning. The model accurately predicts a straight path with 79% mean average precision (mAP), the right path with 83% mAP, and the left path with 85% mAP. The average accuracy of the wearable model is 82.33% and that of the smart stick is 96.14% which combined gives an overall accuracy of 89.24%. Contribution: This research contributes to the design of a low-cost navigational standalone system that will be handy to use and help people to navigate safely in real-time scenarios. The challenging self-built dataset of various paths is generated and transfer learning is performed on the YOLO-v5 model after augmentation and manual annotation. To analyze and evaluate the model, various metrics, such as model losses, recall value, precision, and maP, are used. Findings: These were the main findings of the study: • To detect objects, the deep learning model uses a higher version of YOLO, i.e., a YOLOv5 detector, that may help those with visual im-pairments to improve their quality of navigational mobilities in known or unknown environments. • The developed standalone model has an option to be integrated into any other assistive applications like Electronic Travel Aids (ETAs) • It is the single neural network technology that allows the model to achieve high levels of detection accuracy of around 0.823 mAP with a custom dataset as compared to 0.895 with the COCO dataset. Due to its lightning-speed of 45 FPS object detection technology, it has become popular. Recommendations for Practitioners: Practitioners can help the model’s efficiency by increasing the sample size and classes used in training the model. Recommendation for Researchers: To detect objects in an image or live cam, there are various algorithms, e.g., R-CNN, Retina Net, Single Shot Detector (SSD), YOLO. Researchers can choose to use the YOLO version owing to its superior performance. Moreover, one of the YOLO versions, YOLOv5, outperforms its other versions such as YOLOv3 and YOLOv4 in terms of speed and accuracy. Impact on Society: We discuss new low-cost technologies that enable visually impaired people to navigate effectively in indoor environments. Future Research: The future of deep learning could incorporate recurrent neural networks on a larger set of data with special AI-based processors to avoid latency. Full Article
ea Perceptions of Senior Academic Staff in Colleges of Education Regarding Integration of Technology in Online Learning By Published On :: 2022-08-05 Aim/Purpose: The goal of the study was to examine the perceptions of senior academic staff who also serve as policymakers in Israeli colleges of education, regarding the integration of technology in teacher education, and the shift to online learning during the Covid-19 pandemic. There is little research on this issue and consequently, the aim of the present study is to fill this lacuna. Background: In Israel, senior academic staff in colleges of education play a particularly important role in formulating institutional policies and vision regarding the training of preservice teachers. They fulfil administrative functions, teach, and engage in research as part of their academic position. During the Covid-19, they led the shift to online learning. However, there is little research on their perceptions of technology integration in teacher education in general, and during the Covid-19, in particular. Methodology: This qualitative study conducted semi-structured interviews with 25 senior academic staff from 13 academic colleges of education in Israel. Contribution: The study has practical implications for the implementation of technology in teacher education, suggesting the importance of establishing open discourse and collaboration between college stakeholders to enable enactment of a vision for equity-that allows programs to move swiftly from crisis-management to innovation and transformation during the Covid-19 pandemic. Findings: The findings obtained from content analysis of the interviews reveals a central concept: “On both sides of the divide”, and points of intersection in the perceptions of the senior academic staff. The central concept encompassed three themes: (1) centralization - between top-down and bottom-up policies, (2) between innovation and conservation, and (3) between crisis and growth. The findings indicate that in times of crisis, the polarity surrounding issues essential to the organisation’s operation is reduced, and a blend is formed to create a new reality in which the various dichotomies merge. Recommendations for Practitioners: The study has practical implications for the scope of discussions on the implementation of technology in teacher education (formulating a vision and policies, and their translation into practice), suggesting that such discussions should consider the perceptions of policymakers. Recommendation for Researchers: The findings reflect the challenges faced by senior academic staff at colleges of education that reflect the ongoing attempts to negotiate and reconcile different concerns. Impact on Society: The findings have implications for colleges of education that are responsible for pre-service teachers' teaching practices. Future Research: An enacted vision for equity-based educator preparation that allows programs to move swiftly from crisis-management to innovation and transformation. Future research might reveal a more complete picture by investigating a broader spectrum of stakeholders both in Israel and elsewhere. Hence, future research should examine the power relations between senior college staff and external bodies such as the Higher Education Council (which determines higher education policies in Israel). Full Article
ea Categorizing Well-Written Course Learning Outcomes Using Machine Learning By Published On :: 2022-07-07 Aim/Purpose: This paper presents a machine learning approach for analyzing Course Learning Outcomes (CLOs). The aim of this study is to find a model that can check whether a CLO is well written or not. Background: The use of machine learning algorithms has been, since many years, a prominent solution to predict learner performance in Outcome Based Education. However, the CLOs definition is still presenting a big handicap for faculties. There is a lack of supported tools and models that permit to predict whether a CLO is well written or not. Consequently, educators need an expert in quality and education to validate the outcomes of their courses. Methodology: A novel method named CLOCML (Course Learning Outcome Classification using Machine Learning) is proposed in this paper to develop predictive models for CLOs paraphrasing. A new dataset entitled CLOC (Course Learning Outcomes Classes) for that purpose has been collected and then undergone a pre-processing phase. We compared the performance of 4 models for predicting a CLO classification. Those models are Support Vector Machine (SVM), Random Forest, Naive Bayes and XGBoost. Contribution: The application of CLOCML may help faculties to make well-defined CLOs and then correct CLOs' measures in order to improve the quality of education addressed to their students. Findings: The best classification model was SVM. It was able to detect the CLO class with an accuracy of 83%. Recommendations for Practitioners: We would recommend both faculties’ members and quality reviewers to make an informed decision about the nature of a given course outcome. Recommendation for Researchers: We would highly endorse that the researchers apply more machine learning models for CLOs of various disciplines and compare between them. We would also recommend that future studies investigate on the importance of the definition of CLOs and its impact on the credibility of Key Performance Indicators (KPIs) values during accreditation process. Impact on Society: The findings of this study confirm the results of several other researchers who use machine learning in outcome-based education. The definition of right CLOs will help the student to get an idea about the performances that will be measured at the end of a course. Moreover, each faculty can take appropriate actions and suggest suitable recommendations after right performance measures in order to improve the quality of his course. Future Research: Future research can be improved by using a larger dataset. It could also be improved with deep learning models to reach more accurate results. Indeed, a strategy for checking CLOs overlaps could be integrated. Full Article
ea Using Design-Based Research to Layer Career-Like Experiences onto Software Development Courses By Published On :: 2022-06-20 Aim/Purpose: This research aims to describe layering of career-like experiences over existing curriculum to improve perceived educational value. Background: Feedback from students and regional businesses showed a clear need to increase student’s exposure to career-like software development projects. The initial goal was to develop an instructor-optional project that could be used in a single mid-level programming course; however, the pilot quickly morphed into a multi-year study examining the feasibility of agile projects in a variety of settings. Methodology: Over the course of four years, an agile project was honed through repeated Design Based Research (DBR) cycles of design, implementation, testing, communication, and reflective analysis. As is common with DBR, this study did not follow single methodology design; instead, analysis of data coupled with review of literature led to exploration and testing of a variety of methodologies. The review phase of each cycle included examination of best practices and methodologies as determined by analysis of oral and written comments, weekly journals, instructor feedback, and surveys. As a result of participant feedback, the original project was expanded to a second project, which was tested in another Software Engineering (SE) course. The project included review and testing of many academic and professional methodologies, such as Student Ownership of Learning, Flipped Classroom, active learning, waterfall, agile, Scrum, and Kanban. The study was homogenous and quasi-experimental as the population consisted solely of software engineering majors taking required courses; as based on validity of homogenous studies, class sizes were small, ranging from 8 to 20 students. Close interactions between respondents and the instructor provided interview-like settings and immersive data capture in a natural environment. Further, the iterative development practices of DBR cycles, along with the inclusion of participants as active and valued stakeholders, was seen to align well with software development practitioner practices broadly known as agile. Contribution: This study is among the first to examine layering a career-like software development project on top of a course through alteration of traditional delivery, agile development, and without supplanting existing material. Findings: In response to industry recommendations for additional career-like experiences, a standalone agile capstone-like project was designed that could be layered over an existing course. Pilot data reflected positive perceptions of the project, although students did not have enough time to develop a working prototype in addition to completing existing course materials. Participant feedback led to simultaneous development of a second, similar project. DBR examination of both projects resulted in a simplified design and the ability to develop a working prototype, if and only if the instructor was willing to make adjustments to delivery. After four years, a solution was developed that is both stable and flexible. The solution met the original charge in that it required course delivery, not course material, to be adjusted. It is critical to note that when a working prototype is desired, a portion of the lecture should be flipped allowing more time for guided instruction through project-focused active learning and study group requirements. The results support agile for standalone software development projects, as long as passive delivery methods are correspondingly reduced. Recommendations for Practitioners: Based on the findings, implementation of a career-like software development project can be well received as long as active learning components are also developed. Multiple cycles of DBR are recommended if future researchers wish to customize instructional delivery and develop complex software development projects. Programming instructors are recommended to explore hybrid delivery to support development of agile career-like experiences. Small class sizes allowed the researchers to maintain an interview-like setting throughout the study and future studies with larger classes are recommended to include additional subject matter experts such as graduate students as interaction with a subject matter expert was highly valued by students. Recommendation for Researchers: Researchers are recommended to further examine career-like software development experiences that combine active learning with agile methods; more studies following agile and active learning are needed to address the challenges faced when complex software development is taught in academic settings. Further testing of standalone agile project development has now occurred in medium sized in person classes, online classes, independent studies, and creative works research settings; however, further research is needed. Future research should also examine the implementation of agile projects in larger class sizes. Increasing class size should be coupled with additional subject matter experts such as graduate students. Impact on Society: This study addresses professional recommendations for development of agile career-like experiences at the undergraduate level. This study provides empirical evidence of programming projects that can be layered over existing curriculum, with no additional cost to the students. Initial feedback from local businesses and graduates, regarding agile projects with active learning, has been positive. The area business that refused to hire our underprepared SE graduates has now hired several. Future Research: Future research should explore layering agile projects over a broader range of software development courses. Feedback from hiring professionals and former students has been positive. It is also recommended that DBR be used to develop career-like experiences for online programming courses. Full Article
ea Implementing Team-Based Learning: Findings From a Database Class By Published On :: 2022-01-17 Aim/Purpose: The complexity of today’s organizational databases highlights the importance of hard technical skills as well as soft skills including teamwork, communication, and problem-solving. Therefore, when teaching students about databases it follows that using a team approach would be useful. Background: Team-based learning (TBL) has been developed and tested as an instructional strategy that leverages learning in small groups in order to achieve increased overall effectiveness. This research studies the impact of utilizing team-based learning strategies in an undergraduate Database Management course in order to determine if the methodology is effective for student learning related to database technology concepts in addition to student preparation for working in database teams. Methodology: In this study, a team-based learning strategy is implemented in an undergraduate Database Management course over the course of two semesters. Students were assessed both individually and in teams in order to see if students were able to effectively learn and apply course concepts on their own and in collaboration with their team. Quantitative and qualitative data was collected and analyzed in order to determine if the team approach improved learning effectiveness and allowed for soft skills development. The results from this study are compared to previous semesters when team-based learning was not adopted. Additionally, student perceptions and feedback are captured. Contribution: This research contributes to the literature on database education and team-based learning and presents a team-based learning process for faculty looking to adopt this methodology in their database courses. This research contributes by showing how the collaborative assessment aspect of team-based learning can provide a solution for the conceptual and collaborative needs of database education. Findings: Findings related to student learning and perceptions are presented illustrating that team-based learning can lead to improvements in performance and provides a solution for the conceptual and collaborative needs of database education. Specifically, the findings do show that team scores were significantly higher than individual scores when completing class assessments. Student perceptions of both their team members and the team-based learning process were overall positive with a notable difference related to the perception of team preparedness based on gender. Recommendations for Practitioners: Educational implications highlight the challenges of team-based learning for assessment (e.g., gender differences in perceptions of team preparedness), as well as the benefits (e.g., development of soft skills including teamwork and communication). Recommendation for Researchers: This study provides research implications supporting the study of team assessment techniques for learning and engagement in the context of database education. Impact on Society: Faculty looking to develop student skills in relation to database concepts and application as well as in relation to teamwork and communication may find value in this approach, ultimately benefiting students, employers, and society. Future Research: Future research may examine the methodology from this study in different contexts as well as explore different strategies for group assignments, room layout, and the impact of an online environment. Full Article
ea Charting the Growth and Structure of Early ChatGPT-Education Research: A Bibliometric Study By Published On :: 2023-12-09 Aim/Purpose: The purpose of this article is to provide an overview and analysis of the emerging research landscape surrounding the integration of ChatGPT into education. The main problem appears to be that this is a new, rapidly developing research area for which there is no comprehensive synthesis of the current literature. The aim of the article is to fill this gap by conducting a timely bibliometric study to map publication trends, influential works, themes, and opportunities, thus representing the growth and structure of ChatGPT educational research. Background: This article addresses the issue of the lack of a comprehensive synthesis of the new research on ChatGPT in education by conducting a bibliometric analysis. Specifically, the authors use statistical and network analysis techniques to examine the patterns of publication, citation, and keywords and map the growth, contributions, themes, structure, and opportunities in this evolving field. The bibliometric approach provides a comprehensive, evidence-based overview of the current state of the literature to uncover trends and gaps and help researchers improve their understanding of appropriate and effective applications of ChatGPT in educational contexts. Methodology: The authors used bibliometric analysis as the primary method to summarize the new research on ChatGPT in education. We searched the database of the Web of Science Core Collection to find 51 relevant documents from 2023 that included ChatGPT in the title and were classified as ‘educational research.’ The sample consisted of these 51 documents, including articles, early access articles, editorials, reviews, and letters. Statistical techniques examined publication, citation, and keyword patterns. Network analysis visualized citation and co-occurrence networks to reveal intellectual structure. The multifaceted bibliometric approach allowed a comprehensive study of the sample from a productive, conceptual, and intellectual perspective. Contribution: This article conducts comprehensive bibliometric analysis of this emerging research area and synthesizes publication, citation, and keyword data to map the growth and structure of the literature. The results reveal important trends, such as the rapid growth of publications since the release of ChatGPT, initial authorship patterns, the focus on higher education applications, and distinct research clusters around pedagogical, ethical, and assessment issues. Visualizing citation networks identifies seminal studies while mapping co-occurrence clarifies conceptual relationships between topics. The comparative analysis highlights the differences between document types, topics, and time periods. Knowledge mapping highlights gaps in the literature, such as lack of focus on K-12 contexts, and highlights opportunities for further research. Findings: Key findings from this bibliometric analysis of the emerging research land-scape surrounding ChatGPT integration in education include the following: • Since ChatGPT was released in late 2022, the number of releases has increased significantly, indicating rapid growth in this emerging space. • The most cited authors initially came primarily from Anthropic, but over time, the citations spread throughout the research community. • The topics focused primarily on higher education applications, with a clear focus on pedagogical strategies, ethical risks, and implications for assessment. • Citation networks visualized seminal studies, while the co-occurrence of keywords clarified conceptual connections. • Gaps such as applications in the K-12 context were uncovered, and opportunities for further research were highlighted. • The literature is rapidly evolving and requires ongoing monitoring of the development of this field. In general, the analysis presents the productivity, contributors, themes, struc-ture, and opportunities in this emerging area around the integration of ChatGPT in education based on current scientific evidence. The key findings focus on the growing early interest, gaps and developments that can provide insight for researchers and educators. Recommendations for Practitioners: Practitioners should carefully integrate ChatGPT into education based on new evidence, carefully assess contextual applicability, and proactively develop guidelines for ethical and equitable implementation. Ongoing advice, impact monitoring, and research partnerships are crucial to informing best practices. Educators must be vigilant for risks such as privacy, student well-being, and competence impairment while staying abreast of advances in knowledge to dynamically adapt integration strategies. The introduction should empower diverse learners through measured, integrative approaches based on continuous contextual analysis and ethical principles. Recommendation for Researchers: This article recommends that researchers conduct more studies in under-researched contexts, use multiple methods to capture nuanced impacts, increase focus on responsible integration strategies, develop tailored assessments, conduct interdisciplinary collaborations, monitor long-term adoption, mix with interactive explain and publish open access technologies, help guide adoption pathways through actionable studies, and synthesize the exponentially growing literature through updated systematic reviews. Impact on Society: The rapid publication growth and prevailing optimism suggest that the integration of ChatGPT into education will accelerate, increasing the need for rigorous research that guides ethical, responsible innovations that avoid risks and improve outcomes in all educational contexts. The findings have broader implications for guiding adoption trajectories through ongoing evidence synthesis and expanded investigations in under-researched areas to address knowledge gaps. Ultimately, continued monitoring and updated guidance are critical to ensure that ChatGPT’s educational penetration progresses carefully by maximizing benefits and minimizing harms in rapidly evolving AI-powered learning ecosystems. Future Research: Based on the basic mapping provided by this paper, recommended research directions include longitudinal impact studies, research tailored to under-researched contexts such as K-12, qualitative research to capture stakeholder perspectives, development and testing of AI-calibrated assessments as well as explorations that combine conversational and interactive learning technologies, updated systematic reviews, and co-designed implementation research that explain pedagogical strategies that ethically unlock learning potential while mitigating risks in diverse educational environments. Such multilayered tracking can provide critical insights to guide context-specific, responsible ChatGPT integration and monitor impact within rapidly evolving AI-powered education ecosystems. Full Article
ea Unveiling the Digital Equation Through Innovative Approaches for Teaching Discrete Mathematics to Future Computer Science Educators By Published On :: 2023-11-06 Aim/Purpose: This study seeks to present a learning model of discrete mathematics elements, elucidate the content of teaching, and validate the effectiveness of this learning in a digital education context. Background: Teaching discrete mathematics in the realm of digital education poses challenges, particularly in crafting the optimal model, content, tools, and methods tailored for aspiring computer science teachers. The study draws from both a comprehensive review of relevant literature and the synthesis of the authors’ pedagogical experiences. Methodology: The research utilized a system-activity approach and aligned with the State Educational Standard. It further integrated the theory of continuous education as its psychological and pedagogical foundation. Contribution: A unique model for instructing discrete mathematics elements to future computer science educators has been proposed. This model is underpinned by informative, technological, and personal competencies, intertwined with the mathematical bedrock of computer science. Findings: The study revealed the importance of holistic teaching of discrete mathematics elements for computer science teacher aspirants in line with the Informatics educational programs. An elective course, “Elements of Discrete Mathematics in Computer Science”, comprising three modules, was outlined. Practical examples spotlighting elements of mathematical logic and graph theory of discrete mathematics in programming and computer science were showcased. Recommendations for Practitioners: Future computer science educators should deeply integrate discrete mathematics elements in their teaching methodologies, especially when aligning with professional disciplines of the Informatics educational program. Recommendation for Researchers: Further exploration is recommended on the seamless integration of discrete mathematics elements in diverse computer science curricula, optimizing for varied learning outcomes and student profiles. Impact on Society: Enhancing the quality of teaching discrete mathematics to future computer science teachers can lead to better-educated professionals, driving advancements in the tech industry and contributing to societal progress. Future Research: There is scope to explore the wider applications of the discrete mathematics elements model in varied computer science sub-disciplines, and its adaptability across different educational frameworks. Full Article
ea Utilizing Design Thinking to Create Digital Self-Directed Learning Environment for Enhancing Digital Literacy in Thai Higher Education By Published On :: 2023-08-25 Aim/Purpose: To explore the effectiveness of utilizing the design thinking approach in developing digital self-directed learning environment to enhance digital literacy skills in Thai higher education. Background: To foster digital literacy skills in higher education, Thai students require more than access to technology. Emphasizing digital self-directed learning and incorporating Design Thinking approach, can empower students to learn and develop their digital skills effectively. This study explores the impact of digital self-directed learning environment, developed using a design thinking approach, on enhancing digital literacy skills among higher education students in Thailand. Methodology: The research methodology involves developing a digital self-directed learning environment, collecting and analyzing data, and using statistical analysis to compare the outcomes between different groups. The sample includes 60 undergraduate students from the School of Industrial Education and Technology at King Mongkut Institute of Technology, divided into a control group (n=30) and an experimental group (n=30). Data analysis involves mean, standard deviation, and one-way MANOVA. Contribution: This research contributes to the evidence supporting the use of Design Thinking in developing digital self-directed learning environment, demonstrating its effectiveness in meeting learners’ needs and improving learning outcomes in higher education. Findings: Key findings include: 1) the digital media and self-directed learning activities plan developed through the design thinking approach received high-quality ratings from experts, with mean scores of 4.87 and 4.93, respectively; and 2) post-lesson comparisons of learning outcome and digital literacy assessment scores revealed that the group utilizing digital media with self-directed learning activities had significantly higher mean scores than the traditional learning group, with a significance level of 0.001. Recommendations for Practitioners: Practitioners in higher education should use design thinking to develop digital self-directed learning environments that enhance digital literacy skills. This approach involves creating high-quality digital media and activities, promoting engagement and improved outcomes. Collaboration and stakeholder involvement are essential for effective implementation. Recommendation for Researchers: Researchers should continue to explore the effectiveness of design thinking approaches in the development of learning environments, as well as their influence on different educational aspects such as student engagement, satisfaction, and overall learning outcomes. Impact on Society: By enhancing digital literacy skills among higher education students, this study contributes to the development of a digitally skilled workforce, encourages lifelong learning, and aids individuals in effectively navigating the challenges of the digital era. Future Research: Future research could explore a broader range of student demographics and educational settings to validate the effectiveness of the Design Thinking approach in enhancing digital literacy. This could include integrating design thinking with alternative digital learning and teaching methods to further improve digital literacy. Full Article
ea Measurement of Doctoral Students’ Intention to Use Online Learning: A SEM Approach Using the TRAM Model By Published On :: 2023-08-22 Aim/Purpose: The study aims to supplement existing knowledge of information systems by presenting empirical data on the factors influencing the intentions of doctoral students to learn through online platforms. Background: E-learning platforms have become popular among students and professionals over the past decade. However, the intentions of the doctoral students are not yet known. They are an important source of knowledge production in academics by way of teaching and research. Methodology: The researchers collected data from universities in the Delhi National Capital Region (NCR) using a survey method from doctoral students using a convenience sampling method. The model studied was the Technology Readiness and Acceptance Model (TRAM), an integration of the Technology Readiness Index (TRI) and Technology Acceptance Model (TAM). Contribution: TRAM provides empirical evidence that it positively predicts behavioral intentions to learn from online platforms. Hence, the study validated the model among doctoral students from the perspective of a developing nation. Findings: The model variables predicted 49% of the variance in doctoral students’ intent. The TRAM model identified motivating constructs such as optimism and innovativeness as influencing TAM predictors. Finally, doctoral students have positive opinions about the usefulness and ease of use of online learning platforms. Recommendations for Practitioners: Academic leaders motivate scholars to use online platforms, and application developers to incorporate features that facilitate ease of use. Recommendation for Researchers: Researchers can explore the applicability of TRAM in other developing countries and examine the role of cultural and social factors in the intent to adopt online learning. Future Research: The influence of demographic variables on intentions can lead to additional insights. Full Article
ea COVID-19 Pandemic and the Use of Emergency Remote Teaching (ERT) Platforms: Lessons From a Nigerian University By Published On :: 2023-07-27 Aim/Purpose: This study examines the use of the Emergency Remote Teaching (ERT) platform by undergraduates of the University of Ibadan, Nigeria, during the COVID-19 pandemic using the constructs of the UTAUT2 model. Five constructs of the UTAUT2 model were adopted to investigate the use of the ERT platform by undergraduates of the university. Background: The Coronavirus (COVID-19) outbreak disrupted academic activities in educational institutions, leading to an unprecedented school closure globally. In response to the pandemic, higher educational institutions adopted different initiatives aimed at ensuring the uninterrupted flow of their teaching and learning activities. However, there is little research on the use of ERT platforms by undergraduates in Nigerian universities. Methodology: The descriptive survey research design was adopted for the study. The multi-stage random sampling technique was used to select 334 undergraduates at the University of Ibadan, Nigeria, while a questionnaire was used to collect data from 271 students. Quantitative data were collected and analyzed using frequency counts, percentages, mean and standard deviation, Pearson Product Moment Correlation, and regression analysis. Contribution: The study contributes to understanding ERT use in the educational institutions of Nigeria – Africa’s most populous country. Furthermore, the study adds to the existing body of knowledge on how the UTAUT2 Model could explain the use of information technologies in different settings. Findings: Findings revealed that there was a positive significant relationship between habit, hedonic motivation, price value, and social influence on the use of ERT platforms by undergraduates. Hedonic motivation strongly predicted the use of ERT platforms by most undergraduates. Recommendations for Practitioners: As a provisional intervention in times of emergencies, the user interface, navigation, customization, and other aesthetic features of ERT platforms should be more appealing and enjoyable to ensure their optimum utilization by students. Recommendation for Researchers: More qualitative research is required on users’ satisfaction, concerns, and support systems for ERT platforms in educational institutions. Future studies could consider the use of ERT by students in different countries and contexts such as students participating in English as a Foreign Language (EFL) and the English for Speakers of other languages (ESOL) programs. Impact on Society: As society faces increased uncertainties of the next global pandemic, this article reiterates the crucial roles of information technology in enriching teaching and learning activities in educational institutions. Future Research: Future research should focus on how different technology theories and models could explain the use of ERT platforms at different educational institutions in other geographical settings and contexts. Full Article
ea Unveiling Learner Emotions: Sentiment Analysis of Moodle-Based Online Assessments Using Machine Learning By Published On :: 2023-07-24 Aim/Purpose: The study focused on learner sentiments and experiences after using the Moodle assessment module and trained a machine learning classifier for future sentiment predictions. Background: Learner assessment is one of the standard methods instructors use to measure students’ performance and ascertain successful teaching objectives. In pedagogical design, assessment planning is vital in lesson content planning to the extent that curriculum designers and instructors primarily think like assessors. Assessment aids students in redefining their understanding of a subject and serves as the basis for more profound research in that particular subject. Positive results from an evaluation also motivate learners and provide employment directions to the students. Assessment results guide not just the students but also the instructor. Methodology: A modified methodology was used for carrying out the study. The revised methodology is divided into two major parts: the text-processing phase and the classification model phase. The text-processing phase consists of stages including cleaning, tokenization, and stop words removal, while the classification model phase consists of dataset training using a sentiment analyser, a polarity classification model and a prediction validation model. The text-processing phase of the referenced methodology did not utilise tokenization and stop words. In addition, the classification model did not include a sentiment analyser. Contribution: The reviewed literature reveals two major omissions: sentiment responses on using the Moodle for online assessment, particularly in developing countries with unstable internet connectivity, have not been investigated, and variations of the k-fold cross-validation technique in detecting overfitting and developing a reliable classifier have been largely neglected. In this study we built a Sentiment Analyser for Learner Emotion Management using the Moodle for assessment with data collected from a Ghanaian tertiary institution and developed a classification model for future sentiment predictions by evaluating the 10-fold and the 5-fold techniques on prediction accuracy. Findings: After training and testing, the RF algorithm emerged as the best classifier using the 5-fold cross-validation technique with an accuracy of 64.9%. Recommendations for Practitioners: Instead of a closed-ended questionnaire for learner feedback assessment, the open-ended mechanism should be utilised since learners can freely express their emotions devoid of restrictions. Recommendation for Researchers: Feature selection for sentiment analysis does not always improve the overall accuracy for the classification model. The traditional machine learning algorithms should always be compared to either the ensemble or the deep learning algorithms Impact on Society: Understanding learners’ emotions without restriction is important in the educational process. The pedagogical implementation of lessons and assessment should focus on machine learning integration Future Research: To compare ensemble and deep learning algorithms Full Article
ea Digital Technologies Easing the Learning Curve in the Transition to Practicum By Published On :: 2023-07-04 Aim/Purpose: This study aims to explore the value of utilizing non-immersive virtual reality (VR) to create virtual learning environments (VLEs) to support and prepare optometry students in their transition into preclinical and clinical teaching spaces. Background: Digital education is widely integrated into university curricula with the use of online simulators, immersive VR, and other digital technologies to support student learning. This study focuses on non-immersive VR as an accessible and low-friction means of accessing VLEs to reduce students’ learning burden. Methodology: Current optometry students were invited to explore 360° 3D panoramic virtual learning environments of preclinical and clinical teaching spaces. Students were recruited to participate in an online Qualtrics survey and individual semi-structured interviews. Quantitative data was analyzed, and thematic analysis was conducted on qualitative data from students’ responses to identify key takeaways on the accessibility and impact of VLEs on students’ learning. Contribution: Non-immersive VR has utility in alleviating student stress and helping transition students into practicum. The VLEs have the means to supplement the curriculum to provide support to students entering the preclinical and clinical teaching spaces. Findings: Students engaged voluntarily with the novel VLEs and utilized the resources to help familiarize themselves with the preclinical and clinical teaching spaces. The open-access resource supported students in their preparation for practical learning and helped to reduce self-reported stress and build confidence prior to entering practical classes. Many of the students enjoyed the experience of navigating through the spaces, which helped to appease their curiosity and reduce the learning curve associated with entering new spaces. The VLEs did not replace attending practical spaces but rather were supportive learning resources that aided students due to limited face-to-face contact hours. For students with existing familiarity with the spaces, through their in-person attendance in pre-clinical and clinical teaching sessions prior to accessing the VLEs, the digital resources were not as beneficial compared to students who were still transitioning into practicum. Recommendations for Practitioners: Introductory digital resources like non-immersive VR are accessible platforms that help to orient and familiarize students with new environments. VLEs can potentially help to relieve student stress and reduce the learning load associated with entering practicum or new learning spaces. Recommendation for Researchers: More work needs to be done on how student preparation can translate to feeling less stressed and more confident in relation to transitioning from traditional learning environments to practical learning spaces. Impact on Society: A broader application of non-immersive VR can be implemented as an introductory learning preparation tool across different disciplines to alleviate student stress and maximize the limited time in practicum to allow focus on learning outcomes and practical skills. Future Research: Future studies should consider different cohorts to study, with a focus on objective measures of engagement with VLEs. The effect of VLEs on students’ cognitive load should be assessed and assessment of self-perceived stress can be evaluated with instruments such as Cohen’s Perceived Stress Scale. Full Article
ea Playable Experiences Through Technologies: Opportunities and Challenges for Teaching Simulation Learning and Extended Reality Solution Creation By Published On :: 2023-06-05 Aim/Purpose: This paper describes a technologies education model for introducing Simulation Learning and Extended Reality (XR) solution creation skills and knowledge to students at the tertiary education level, which is broadly applicable to higher education-based contexts of teaching and learning. Background: This work is made possible via the model’s focus on advancing knowledge and understanding of a range of digital resources, and the processes and production skills to teach and produce playable educational digital content, including classroom practice and applications. Methodology: Through practice-based learning and technology as an enabler, to inform the development of this model, we proposed a mixed-mode project-based approach of study within a transdisciplinary course for Higher Education students from the first year through to the post-graduate level. Contribution: An argument is also presented for the utility of this model for upskilling Pre-service Teachers’ (PSTs) pedagogical content knowledge in Technologies, which is especially relevant to the Australian curriculum context and will be broadly applicable to various educative and non-Australian settings. Findings: Supported by practice-based research, work samples and digital projects of Simulation Learning and XR developed by the authors are demonstrated to ground the discussion in examples; the discussion that is based around some of the challenges and the technical considerations, and the scope of teaching digital solutions creation is provided. Recommendations for Practitioners: We provide a flexible technologies teaching and learning model for determining content for inclusion in a course designed to provide introductory Simulation Learning and XR solution creation skills and knowledge. Recommendation for Researchers: The goal was to provide key criteria and an outline that can be adapted by academic researchers and learning designers in various higher education-based contexts of teaching and inclusive learning design focused on XR. Impact on Society: We explore how educators work with entities in various settings and contexts with different priorities, and how we recognise expertise beyond the institutional interests, beyond discipline, and explore ‘what is possible’ through digital technologies for social good and inclusivity. Future Research: The next step for this research is to investigate and explore how XR and Simulation Learning could be utilised to accelerate student learning in STEM and HASS disciplines, to promote knowledge retention and a higher level of technology-enhanced learning engagement. Full Article
ea MOOC Appropriation and Agency in Face-to-Face Learning Communities By Published On :: 2023-05-03 Aim/Purpose: The emergence of massive open online courses (MOOCs) has fostered the creation of co-located learning communities; however, there is limited research on the types of interactions unfolding in these spaces. Background: This study explores Peer 2 Peer University’s Learning Circles, a project that allows individuals to take MOOCs together at the library. I investigated the patterns that emerged from the interactions between facilitators, learners, course materials, and digital media in the pilot round of these Learning Circles. Methodology: This study employs an ethnography of hybrid spaces (online/offline participant observations, in-depth interviews, and artifact collection) of face-to-face study groups taking place at library branches in a Midwest metropolitan area. Data analysis employs the constant comparison method. Contribution: Interactions taking place in the Learning Circles increased individuals’ agency as learners and subverted the MOOC model through processes of technological appropriation. Findings: The findings reveal that interactions within Learning Circles created a dynamic negotiation of roles, produced tension points, enabled a distributed model of knowledge, and structured study routines. The pilot round of Learning Circles attracted diverse participants beyond the typical digitally literate MOOC student. Many of them had no previous experience taking online courses and, in some cases, no Internet connection at home. This paper argues that Learning Circles favored the appropriation of artifacts (technologies) and increased participants’ agency as learners in the Internet age. Recommendations for Practitioners: Practitioners can use the Learning Circles model to benefit disenfranchised individuals by providing them with access to materials resources and a network of peers that can help increase their agency as learners. Recommendation for Researchers: This study suggests that it is fundamental to pay attention to learning initiatives that are unfolding outside the scope of traditional and formal education. Impact on Society: Open educational resources and public libraries are opening new pathways for learning beyond traditional higher education institutions. Future Research: Future research can explore how the learning circles are adapted in cultural contexts outside the United States. Full Article
ea Key Factors for a Creative Environment in Saudi Arabian Higher Education Institutions By Published On :: 2023-04-29 Aim/Purpose: This research explores the influence of organizational-level and individual-level creativity and innovation and the technology acceptance model toward the higher education creative environment that consists of research creativity and teaching creativity. Background: Creativity and innovation are essential pillars for higher education institutions (HEIs). The two terms are interconnected, where creativity is referring to finding better ideas to do the work, while innovation is referring to how to do and implement these creative ideas. Choosing the optimal creative process and the organizational support needed to develop it is an important goal in achieving a creative and inventive environment. For the success of the creative environment to ensure the improvement of higher education institutions, information technology as social networking sites plays a crucial part in the creative process within universities. However, assessing the creativity and innovation of Saudi higher education institutions has not been well recognized. Universities today serve as knowledge-based institutions because they are at the forefront of cutting-edge R&D and scientific innovations. Creating such a productive research environment in universities, however, necessitates a work culture that encourages employees to be more creative while also encouraging the creation of new ideas and innovations. Methodology: A survey instrument was utilized as a quantitative method for this research to gather data from the study sample on the influencing variables employed in the research framework. Respondent data were analyzed using a disjoint two-stage method using PLS-SEM path modelling. Contribution: The results of this research contribute to the theoretical and scientific literature by offering a model of creativity and innovation in higher education institutions. The model proposes an optimal blend of organizational, individual, and technology variables that contribute to the development of the Higher Education Creative Environment in HEIs via creativity in teaching and research and a culture of innovation. In another way, the proposed framework especially helps to comprehend the challenges regulating establishing teaching and research creativity in HEIs via the adoption of organizational, individual, and technology enablers identified as part of this study. Findings: According to the results, organizational factors such as organizational encouragement, freedom, and challenging work have a positive relationship with the higher education creative environment. However, realistic work pressure, a lack of organizational impediments, managerial encouragement, and work group support is insufficient to affect the creative environment in higher education in Saudi Arabia. Individual variables (creative thinking skills and expertise, for example) also have a positive impact on the higher education creative environment. In the higher education creative environment, however, the influence of intrinsic motivation is insignificant. Finally, technology factors such as social networking site adoption intention, perceived usefulness, and perceived ease of use have the potential to influence the higher education creative environment. Recommendations for Practitioners: On the practical front, the obvious recommendation of this research is that it enables top leadership in Saudi HEIs to rethink the norms of creativity and innovation in their institutions, thereby instilling a mindset guided by a flourishing culture of creativity in the HEI environment with a specific focus on creativity practices in research and teaching domains. Furthermore, to promote the environment’s creativity within Saudi Arabian HEIs, university leaders must consider the suggested Organizational, Individual, and Technology factors as key enablers of creativity and innovation, which will guide them in revisiting their strategic actions in terms of further augmenting the creative performance of their academic’s staff, thereby sustaining a culture of Higher Education Creative Environment (HECE). Recommendation for Researchers: This study addressed many organizational, individual, and technology variables that facilitate Saudi Arabian HECE accomplishment in the form of research and teaching creativity. Furthermore, fresh insights for Saudi public HEIs are revealed when the success aspects of the creative environment are considered. If academic leadership at Saudi HEIs is to encourage the creative environment in general and creativity in teaching and research, it would be suitable for them to highlight individual, organizational, and technology success elements. As a result, their HEIs will be able to produce more innovative research, products, and services that can support and meaningfully achieve national transformation initiatives, opening the path for a transition into a knowledge-based economy. Impact on Society: In fact, this research is based on a quantitative research method, and the findings were also significant especially considering the current global crises. It is clearly understood by this process that includes organizational, individual, and technology factors as key enablers of the creative performance of academic staff, thereby sustaining a culture of HECE. Future Research: While providing the research model, it is probable that this study overlooked any other crucial aspects influencing creativity and innovation. As a result, future research should look at additional variables that may impact HECE in Saudi Arabian HEIs. Furthermore, while this study focused on deriving HECE with a particular emphasis on research and teaching creativity as results, future research might look at deriving other creativity outcomes (e.g., entrepreneurial creativity) within the investigated HECE dimension. Full Article
ea A Constructionist Approach to Learning Computational Thinking in Mathematics Lessons By Published On :: 2024-09-02 Aim/Purpose: This study presents some activities that integrate computational thinking (CT) into mathematics lessons utilizing GeoGebra to promote constructionist learning. Background: CT activities in the Indonesian curriculum are dominated by worked examples with less plugged-mode activities that might hinder students from acquiring CT skills. Therefore, we developed mathematics and CT (math+CT) lessons to promote students’ constructionist key behaviors while learning. Methodology: The researchers utilized an educational design research (EDR) to guide the lesson’s development. The lesson featured 11 applets and 22 short questions developed in GeoGebra. To improve the lesson, it was sent to eight mathematics teachers and an expert in educational technology for feedback, and the lesson was improved accordingly. The improved lessons were then piloted with 17 students, during which the collaborating mathematics teachers taught the lessons. Data were collected through the students’ work on GeoGebra, screen recording when they approached the activities, and interviews. We used content analysis to analyze the qualitative data and presented descriptive statistics to quantitative data. Contribution: This study provided an example and insight into how CT can be enhanced in mathematics lessons in a constructionist manner. Findings: Students were active in learning mathematics and CT, especially when they were engaged in programming and debugging tasks. Recommendations for Practitioners: Educators are recommended to use familiar mathematics software such as GeoGebra to support students’ CT skills while learning mathematics. Additionally, our applets are better run on big-screen devices to optimize students’ CT programming and debugging skills. Moreover, it is recommended that students work collaboratively to benefit from peer feedback and discussion. Recommendation for Researchers: Collaboration with teachers will help researchers better understand the situation in the classroom and how the students will respond to the activities. Additionally, it is important to provide more time for students to get familiar with GeoGebra and start with fewer errors to debug. Future Research: Further research can explore more mathematics topics when integrating CT utilizing GeoGebra or other mathematics software or implement the lessons with a larger classroom size to provide a more generalizable result and deeper understanding. Full Article
ea Adoption and Usage of Augmented Reality-based Virtual Laboratories Tool for Engineering Studies By Published On :: 2024-08-25 Aim/Purpose: The study seeks to utilize Augmented Reality (AR) in creating virtual laboratories for engineering education, focusing on enhancing teaching methodologies to facilitate student understanding of intricate and theoretical engineering principles while also assessing engineering students’ acceptance of such laboratories. Background: AR, a part of next-generation technology, has enhanced the perception of reality by overlaying virtual elements in the physical environment. The utilization of AR is prevalent across different disciplines, yet its efficacy in facilitating Science, Technology, Engineering, and Mathematics (STEM) education is limited. Engineering studies, a part of STEM learning, involves complex and abstract concepts like machine simulation, structural analysis, and design optimization; these things would be easy to grasp with the help of AR. This restriction can be attributed to their innovative characteristics and disparities. Therefore, providing a comprehensive analysis of the factors influencing the acceptance of these technologies by students - the primary target demographic – and examining the impact of these factors is essential to maximize the advantages of AR while refining the implementation processes. Methodology: The primary objective of this research is to develop and evaluate a tool that enriches the educational experience within engineering laboratories. Utilizing Unity game engine libraries, digital content is meticulously crafted for this tool and subsequently integrated with geo-location functionalities. The tool’s user-friendly interface allows both faculty and non-faculty members of the academic institution to establish effortlessly the virtual laboratory. Subsequently, an assessment of the tool is conducted through the application of the Unified Theory of Acceptance and Use of Technology (UTAUT2) model, involving the administration of surveys to university students to gauge their level of adaptability. Contribution: The utilization of interactive augmented learning in laboratory settings enables educational establishments to realize notable savings in time and resources, thereby achieving sustainable educational outcomes. The study is of great importance due to its utilization of student behavioral intentions as the underlying framework for developing an AR tool and illustrating the impact of learner experience on various objectives and the acceptance of AR in Engineering studies. Furthermore, the research results enable educational institutions to implement AR-based virtual laboratories to improve student experiences strategically, align with learner objectives, and ultimately boost the adaptability of AR technologies. Findings: Drawing on practice-based research, the authors showcase work samples and a digital project of AR-based Virtual labs to illustrate the evaluation of the adaptability of AR technology. Adaptability is calculated by conducting a survey of 300 undergraduate university students from different engineering departments and applying an adaptability method to determine the behavioral intentions of students. Recommendations for Practitioners: Engineering institutions could leverage research findings in the implementation of AR to enhance the effectiveness of AR technology in practical education settings. Recommendation for Researchers: The authors implement a pragmatic research framework aimed at integrating AR technology into virtual AR-based labs for engineering education. This study delves into a unique perspective within the realm of engineering studies, considering students’ perspectives and discerning their behavioral intentions by drawing upon previous research on technology utilization. The research employs various objectives and learner experiences to assess their influence on students’ acceptance of AR technology. Impact on Society: The use of AR in engineering institutions, especially in laboratory practicals, has a significant impact on society, supported by the UTAUT2 model. UTAUT2 model assesses factors like performance, effort expectancy, social influence, and conditions, showing that AR in education is feasible and adaptable. This adaptability helps students and educators incorporate AR tools effectively for better educational results. AR-based labs allow students to interact with complex engineering concepts in immersive settings, enhancing understanding and knowledge retention. This interactive augmented learning for laboratories saves educational institutions significant time and resources, attaining sustainable learning. Future Research: Further research can employ a more comprehensive acceptance model to examine learners’ adaptability to AR technology and try comparing different adaptability models to determine which is more effective for engineering students. Full Article