Developing learning skills through game-based learning in complex scenarios: A case in undergraduate logistics education

DEVELOPING LEARNING SKILLS THROUGH GAME-BASED
LEARNING IN COMPLEX SCENARIOS: A CASE IN
UNDERGRADUATE LOGISTICS EDUCATION

Ernesto Pacheco-Velazquez1 , Virginia Rodés1* , David Salinas-Navarro2

1Tecnologico de Monterrey (Mexico)

2Aston University: Birmingham (United Kingdom)

Received April 2023

Accepted July 2023

Abstract

This study investigates the impact of game-based learning (GBL), an increasingly popular educational approach, on the development of self-directed learning (SDL) skills in complex scenarios, particularly in undergraduate logistics education. A key component of the three year study is LOST (Logistics Education Simulator), a serious game platform, deployed in an undergraduate engineering course in Mexico. An extensive literature review was carried out using Scopus to examine recent works published between 2019 and 2024, providing a state-of-the-art overview of the field. Subsequently, a survey based on the scale created by Fisher, King and Tague (2001), known for its extensively evaluated internal consistency, revealed five distinct factors of self-directed learning. The findings underscore that the LOST platform significantly enhances self-directed learning, promoting the development of Self-management Skills, Openness to Learning Opportunities, Initiative and Independence in Learning, Self-concept as an Effective Learner, and Love of Learning. The students demonstrated a significant increase in their perception of these skills over the course of the study, highlighting the effectiveness of GBL in promoting such learning skills. These findings highlight the multidimensional nature of learning skills that can be fostered through GBL. The study concludes by discussing the vital role of GBL in complex scenarios, particularly in enhancing the development of self-directed learning skills in undergraduate logistics education.

 

Keywords – Serious games, Game-based learning, Self-directed learning, Logistics education, Educational innovation, Higher education, Virtual learning.

To cite this article:

Pacheco-Velazquez, E., Rodés, V., & Salinas-Navarro, D. (2024). Developing learning skills through game-based learning in complex scenarios: A case in undergraduate logistics education. Journal of Technology and Science Education, 14(1), 169-183. https://doi.org/10.3926/jotse.2219

 

----------

    1. 1. Introduction

In the 21st century, game-based learning (GBL) has become increasingly popular as an educational approach. This technique effectively motivates individuals to voluntarily invest numerous hours in skill development and knowledge acquisition (Bond, Buntins, Bedenlier, Zawacki-Richter & Kerres, 2020). Extensive research emphasizes the various benefits associated with this approach. Games foster continuous learning, enhance comprehension, improve retention, increase participation and engagement, facilitate student collaboration, and promote understanding, among other advantages (Boskic & Hu, 2015). To further explore this direction, this article presents a quantitative study on complex learning skills development in a game-based experience in a logistics undergraduate course within the field of engineering education in México. The course incorporates a serious game and a gamified platform to support self-directed learning (SDL). The aim of this course design was to enhance students’ learning experiences in logistics and cultivate their SDL skills within complex scenarios. In 2017, the online plattform “GOAL Project” was created to support undergraduate students’ learning on supply chain management and increase their engagement. This platform contains innovative learning materials, including videos, notes, quizzes, simulators, and games (Pacheco-Velázquez, 2015; Pacheco-Velazquez & Aguilar-Avalo, 2019; Pacheco-Velazquez & Viscarra-Campos, 2019; Salinas-Navarro, Pacheco-Velazquez, Arana-Solares & Palma-Mendoza, 2020; Pacheco & Palma-Mendoza, 2021; Pacheco-Velazquez, 2022). An adapted version of a well-known SDL survey (Fisher et al., 2001) was implemented from 2017 to 2020 across multiple academic terms. The results demonstrate that through the utilization of the Logistics Simulator (LOST), students were able to develop both independent learning abilities and problem-solving skills, as well as cultivate logical thinking in the context of complex logistics scenarios.

The Fourth Industrial Revolution has brought about a transformative era, integrating digital and information technologies into company processes. This unpredictable society requires economic entities to adapt swiftly and accurately to evolving contexts (Minciu, Berar, & Dobrea, 2020). This paradigm shift impacts management and employment, as new business models emerge, demanding novel learning skills. Professionals must become adept at navigating complex situations, making effective responses crucial. Individuals must become “learners of learning”, and universities must prepare to confront these challenges (LeBlanc, 2018). Therefore, universities must prioritize the incorporation of competencies that foster greater autonomy and independent learning capacity, enabling students to navigate changing situations, uncertainty, and ambiguity (Ramirez-Montoya, Castillo-Martínez, Sanabria-Zepeda & Miranda, 2022; Alfaro-Ponce, Patiño, & Sanabria, 2023). These requirements encompass a broad range of competencies, including openness to new ideas, critical thinking, problem-solving, information search and selection, initiative, and self-direction (van Laar, van Deursen, van Dijk & de Haan, 2020; Almeida & Simoes, 2019). Therefore, this study acknowledges the necessity of promoting self-directed learning (SDL) and implementing strategies to develop the essential skills required for the effective integration of graduates into the labor market (Tekkol & Demirel, 2018). In the short term, universities will need to undergo significant changes, such as the establishment of personalized education tailored to individual needs and the adoption of alternative approaches based on emerging digital communication technologies.

Researchers are increasingly developing educational games to support the teaching of essential 21st‑century skills (Qian & Clark, 2016). These skills, categorized as learning to know, do, be, and live together, include elements of self-directed learning (SDL) like problem-solving, critical thinking, autonomy, and responsibility (Scott, 2015). Moreover, they are closely connected to developing a systemic vision, problem-solving abilities, self-management, information technology proficiency, and decision‑making skills (Sun & Song, 2018; Hubl & Fischer, 2017; Lindberg, 2019; Wong & Mok, 2019; Toh & Kirschner, 2020). Serious games, in particular, are effective in fostering these skills due to their flexibility, enabling students to learn at their own pace (Toh & Kirschner, 2020). Games engage players, offer clear observation opportunities, and encourage the exploration of multiple strategies, contributing significantly to skill elevation (Hallros & Palsson, 2021). As Higher Education adapts to the future, substantial changes are necessary, including transforming teaching methods, conceptualizing new evaluation systems, and integrating innovative technologies to enhance learning in complex scenarios. Critical skills required in the logistics industry have been identified, encompassing social, decision-making, problem-solving, time management, and general knowledge skills (Lutz & Birou, 2013). In logistics undergraduate courses, the increasing use of gamification techniques suggests enhanced engagement and performance (Hubl & Fischer, 2017). Furthermore, simulation frameworks have been employed for supply chain modeling and optimizing production planning problems.

When students engage in GBL, they can test their knowledge and enhance understanding of previously learned concepts (Crocco, Offenholley & Hernandez, 2016). Games offer repeated exercises, adjustable difficulty levels, and modified challenges, providing better support than traditional instruction. GBL fosters perseverance and independence in the learning process (Almeida & Simoes, 2019; Chris, Moldovan, Murphy, Pathak & Muntean, 2018). Video games can offer meaningful contexts and visual representations, making learning material more accessible and relevant, especially for students who may not thrive in traditional environments (Payne, Keith, Schuetzler & Giboney, 2017). Serious games, a part of GBL, serve an educational purpose beyond entertainment, offering specific contextual situations for learning (Abt, 1987; Laamarti, Eid & El-Saddik, 2014). Knowledge acquisition in serious games is tied to the game’s progression and students’ experiential and instrumental attitudes (Rosenthal & Ratan, 2022). They provide valuable learning alternatives, fostering cognitive skills like attention, perception, creativity, and abstract thinking (Zhonggen, 2019; Gaurav, Kaushik, Supraja, Yadav, Gupta & Chaturvedi, 2022). Serious games effectively foster and strengthen essential learning skills, including mathematical and logical reasoning abilities among high school students (Sánchez & Lara, 2021). However, few studies explore the relationship between complex thinking skills and serious games, especially when players can engage at their own pace without assigned learning objectives (Rosenthal & Ratan, 2022).

SDL enhances students’ learning flexibility and independence by developing competencies to navigate uncertainty, search for information, create effective learning strategies, and establish connections between variables (Tekkol & Demirel, 2018). These sub-competencies also foster valuable skills for addressing complexity in a knowledge-driven society (Cavicchi, 2021). SDL is compatible with new technologies, enabling the development of online educational platforms with videos, games, simulators, augmented reality, and virtual reality, offering flexibility and independence to students, and a strong predictor of readiness for online learning (Luu, 2022; Herrera & Valenzuela, 2019; Prihastiwi, Prastuti & Eva, 2021). In SDL, students take responsibility for diagnosing their learning needs, setting goals, selecting materials and strategies, and evaluating outcomes (Knowles, 1975). Self-direction includes self-management, self-control, and self-motivation (Garrison, 1997), crucial attributes for online learners who must organize their own learning. Students with SDL skills perform better in online settings (Chou, 2012). As Higher Education adopts student-centered approaches, SDL gains importance. Digital-native students readily absorb multimedia information, making video games valuable tools for developing SDL in engaging environments that foster independent learning (Kivunja, 2014).

2. State-of-the-Art

The state-of-the-art review aimed to explore the intersection between GBL and the development of learning skills in complex scenarios. To conduct this analysis, a literature review was carried out using Scopus, utilizing the query: TITLE-ABS-KEY (learning AND skills AND game-based AND learning AND complexity) AND PUBYEAR > 2018 AND PUBYEAR < 2024.

The search yielded 34 journal articles and proceedings, which were subjected to a thorough analysis. The examination primarily focused on the Title and Abstract sections, with some cases involving a full-text review. One false positive was identified during this process. The analysis was performed to identify emergent categories based on the primary focus of each paper. Table 1 below presents the papers classified into the emergent categories identified during the analysis.

The retrieved references encompass a broad spectrum of 154 topics, offering a diverse range of subjects within the domain of game-based learning. These topics span various forms of learning, such as “E‑learning”, “Active Learning”, and “Self-directed Learning”. Additionally, specific aspects of games and gaming are explored, including “Serious Games”, “Game Design”, and “Simulation”. Educational environments and institutions, such as “Higher Education”, “Educational Institutions”, and “Virtual Classroom”, are also covered in the dataset.

Category

Reference

Game-Based Learning Methods

Haendler 2019; Rumeser & Emsley, 2019; Dyulicheva & Glazieva, 2022; Bastos, Silva, Poza‑Lujan & KaiSchleut, 2020; Neves & Sousa, 2019; Pacheco, Palma, Salinas & Arana, 2020; Bühler, Jelinek & Nübel, 2022; Horvat, Jagust, Veseli, Malnar & Cizmar, 2022; Santana, 2023; Cruz-Martinez, Soto & Benito, 2022; Taylor, 2020; Tavares, 2022; Sevcenko, Ninaus, Wortha, Moeller & Gerjets, 2021; Sincharoenkul, Tongtep & Boonlamp, 2020; Buzady, Wimmer, Csesznak & Szentesi, 2022; Mahmoud, Kidmose, Broholm, Pilawka, Illés, Magnussen et al., 2020; Bastos et al., 2020; Tseng, Doll & Varma, 2019; Hansen & Elbæk, 2019; Camacho, Sahu & Esteva, 2019; Sharma, Bhagat, Huang & Chen, 2022; Prompolmaueng, Wetmaha & Jamsri, 2021; Lezama, Manotas & Mercado-Caruzo, 2020.

Learning Skills Development

Pogge & Davis, 2021; Pacheco et al., 2020; Alfaro-Ponce et al., 2023; Cruz-Martinez et al., 2022 Tavares, 2022; Sincharoenkul et al., 2020; Cecchi, Rodríguez & Dahl, 2023; Sharma et al., 2022; Prompolmaueng et al., 2021.

Complexity

Czauderna, Guardiola, Lux & Budke, 2021; Rumeser & Emsley, 2019; Sincharoenkul et al., 2020; Biswas, Rajendran, Mohammed, Goldberg, Sottilare, Brawner et al., 2020; Zhang, Gao, Chen, Liu, Wang & Liao, 2020; Hainey, Baxter & Ford, 2020.

Table 1. State-of-the-art categories and references

Top 5 Topics

Bottom 5 Topics (among others)

Game-based Learning (20)

Complex Decision Making (1)

Students (11)

Collaborative Learning (1)

Serious Games (11)

Cognitive Strategy (1)

Gamification (8)

21 Century Skills (1)

Computational Thinking (7)

Complex Problems (1)

Table 2. Most and less cited topics within the references

Furthermore, the set of references delves into technological aspects related to game-based learning, featuring topics like “Augmented Reality”, “Smartphone Applications”, and “Artificial Intelligence”. Skills and competencies are addressed as well, with topics including “Thinking Skills”, “Technical Skills”, and “21st Century Skills” forming part of the dataset. Moreover, specific student populations are represented, with references focusing on “Students”, “Adults”, and “Autistic Children”. The wealth of topics covered in the dataset makes it a comprehensive resource for exploring the diverse landscape of GBL.

This array of topics illustrates the multifaceted nature of game-based learning research to date, encompassing diverse methods, technologies, and educational contexts. The variety of subjects also indicates the potential for GBL to address a range of learning needs and educational goals. Following in Table 2 most and less cited topics are presented.

The set of references showcases a diverse range of subject areas, with a notable concentration in Computer Science, accounting for 25 references. This highlights the significant role of game-based learning research within the computer science domain, where innovative technologies and digital advancements greatly influence educational methodologies.

Following closely, Social Sciences are represented with 23 references, emphasizing the relevance of game‑based learning in understanding human behavior, cognition, and the social impact of educational interventions. This indicates the importance of exploring how games can effectively support learning outcomes and engagement.

Additionally, 14 references come from the field of Engineering, underscoring the application of game-based learning in engineering education. Interactive simulations and serious games are leveraged to enhance technical skills and foster problem-solving abilities among engineering students.

Overall, this diverse collection of references demonstrates the multidisciplinary nature of game-based learning and its influence in various fields, reaffirming its potential to revolutionize and optimize modern educational approaches.

Additionally, the dataset includes 2 references from Decision Sciences, reflecting the growing interest in using game-based approaches to improve decision-making skills and strategies across various industries. Nursing and Psychology each contribute 2 references, underscoring the value of game-based learning in the healthcare sector to enhance clinical reasoning, decision-making, and other critical competencies among healthcare professionals.

This remarkable variety of subject areas showcases the truly interdisciplinary nature of game-based learning research, with its applications extending across multiple domains. It highlights the versatility of game-based learning as an effective educational tool that can be customized to suit different academic fields and learning objectives, making it a valuable asset for educators and researchers alike.

In Figure 1, a graphic representation illustrating the percentage distribution of different domains in the retrieved references is presented, providing a visual overview of the diverse range of subjects covered in the dataset.

 

Figure 1.Different domains in the retrieved references (%) (Copyright © 2023 Elsevier B.V.
All rights reserved. Scopus® is a registered trademark of Elsevier B.V.)

The top 20 most common words reveal key insights. “Game” and “learning” are central topics, with a focus on students’ “skills” development. “Based” and “games” suggest a significant interest in game-based learning approaches. “Education” and “design” indicate efforts to create engaging learning experiences. Researchers explore the “complexity” of implementing games in education, with a focus on “educational” contexts. “Knowledge” and “results” are crucial in understanding the impact of game-based learning. “Teaching”, “new”, and “using” show innovative efforts in utilizing games for instruction. The frequent use of “study” and “research” highlights the substantial body of research in this field. Overall, the analysis indicates a thriving field, with researchers committed to leveraging games to enhance learning, foster essential skills, and address modern educational challenges.

Indeed, the state-of-the-art review presents valuable insights into the current landscape of game-based learning research and its potential to enhance learning skills in complex scenarios. The comprehensive exploration of diverse topics and subject areas demonstrates the wide-ranging scope of this field, prompting further investigation into the application of game-based learning for developing crucial skills in educational settings.

The subsequent sections of the study, namely the methodology, results, and discussion, delve into the findings and experiences of a quantitative four-year study conducted with Mexican engineering undergraduate students. This study offers a valuable contribution to the existing research, shedding light on the effectiveness and impact of game-based learning specifically within the context of engineering education. By sharing their experiences and data, the study provides concrete evidence and practical insights that can inform future educational practices and strategies.

3. Methodology

3.1. Design and Instruments

Based on the classical literature on self-directed learning, the scale created by Fisher et al. (2001) was utilized, whose internal consistency has been extensively evaluated and cited in more than 370 research works. Through factor analysis, the survey revealed five distinct factors, each capturing different aspects of self-directed learning. These factors have been named as follow:

  • Factor 1: Self-management Skills. 

  • Factor 2: Openness to Learning Opportunities. 

  • Factor 3: Initiative and Independence in Learning. 

  • Factor 4: Self-concept as an Effective Learner. 

  • Factor 5: Love of Learning. 

The study utilized a 52-question survey to assess whether there was a change in student perception regarding the importance of self-directed learning before and after the implementation of LOST (the platform and game used for the study). Additionally, the research aimed to explore any potential associations between the survey results and the methodology employed in the classroom.

The first phase of the study involved 311 Mexican engineering undergraduate students who used the platform and game during the school periods of August-December 2017, January-May 2018, August‑December 2018, and January-May 2019. The survey was administered to these students before and after their engagement with the LOST platform, enabling researchers to analyze any shifts in their perception of self-directed learning’s significance and its link to the utilized methodology.

In the second phase, the experiment was conducted during the semesters of August-December 2019 and January-May 2020, specifically in a logistics curricular undergraduate course. The study focused on a population of 53 fifth-semester students pursuing Industrial Engineering. Similarly, the survey was administered to these students at the beginning and conclusion of the course to evaluate potential significant differences in their perception of self-directed learning competencies development.

3.2. Results

Factor analysis serves as a powerful tool to reveal underlying patterns and structures within the data, providing meaningful insights into the dimensions of self-directed learning in this study. The results of the survey application revealed that the 52 questions of the questionnaire could be grouped into five distinct factors. These factors were determined through a principal component analysis extraction method using a Varimax rotation with a Kaiser normalization. The analysis indicated that all items were significant (p < 0.05), confirming the validity of the factor structure. The exploratory factor analysis yielded the following five factors, which collectively explained 63.12% of the total variance:

Factor 1: Self-management Skills: This factor encompasses qualities related to an individual’s ability to organize, manage time effectively, demonstrate self-discipline, and take responsibility for their actions.

Factor 2: Openness to Learning Opportunities: This factor reflects an individual’s willingness to embrace and explore various learning opportunities, demonstrating a receptive and open mindset towards acquiring new knowledge.

Factor 3: Initiative and Independence in Learning: This factor pertains to an individual’s proactiveness and self-reliance in driving their learning journey, taking initiative to engage in learning activities independently.

Factor 4: Self-concept as an Effective Learner: This factor focuses on an individual’s perception of themselves as capable and effective learners, reflecting their self-confidence in their learning abilities.

Factor 5: Love of Learning: This factor represents an individual’s intrinsic motivation and passion for learning, demonstrating a genuine enthusiasm and enjoyment for the process of acquiring new knowledge and skills.

By categorizing the questions into these five factors, the survey effectively reduces the complexity of the data, allowing researchers to analyze and interpret students’ self-directed learning skills based on these distinct categories.

In the second application moment of the study, the researchers sought to determine whether significant differences existed in the students’ perception of developing self-directed learning competencies. To assess these differences, a paired t-test was conducted to compare the responses between the first and second surveys administered to the students.

The results of the paired t-test are presented in Table 4. Based on these results, it can be concluded with 95% confidence that factors considered in students’ self-directed learning demonstrated a statistically significant increase. This indicates that there was a noticeable improvement in the students’ perception of developing self-directed learning skills over the course of the study.

The results of the paired t-test provide strong evidence to support the positive impact of the LOST intervention on students’ perception of developing self-directed learning competencies. This finding reinforces the effectiveness of the game-based approach in fostering important skills for self-directed and independent learning among the participants.

Question

1

2

3

4

5

I am organized

0.718

 

 

 

 

I manage my time well

0.704

 

 

 

 

I am self-disciplined

0.650

 

 

 

 

I am responsible

0.631

 

 

 

 

I prioritize my work

0.618

 

 

 

 

I set specific times for my study

0.606

 

 

 

 

I set strict time frames

0.548

 

 

 

 

I solve problems using a plan

0.496

 

 

 

 

I am systematic in my learning

0.465

 

 

 

 

I am methodical

0.450

 

 

 

 

I need minimal help finding information

0.384

 

 

 

 

I have good management skills

0.359

 

 

 

 

I enjoy studying

0.356

 

 

 

 

I can focus on a problem

0.305

 

 

 

 

I am willing to accept advice from others

 

0.770

 

 

 

I am open to new ideas

 

0.705

 

 

 

I am open to new learning opportunities

 

0.668

 

 

 

I will ask for help in my learning when necessary

 

0.647

 

 

 

When presented with a problem I cannot resolve, I will ask for assistance

 

0.599

 

 

 

I am responsible for my own decisions/actions

 

0.572

 

 

 

I like to gather the facts before I make a decision

 

0.480

 

 

 

I am willing to change my ideas

 

0.473

 

 

 

I learn from my mistakes

 

0.406

 

 

 

I critically evaluate new ideas

 

0.378

 

 

 

I believe the role of the teacher is to act as a resource person

 

0.371

 

 

 

I prefer to direct my own learning

 

 

0.693

 

 

I prefer to set my own learning goals

 

 

0.645

 

 

I prefer to plan my own learning

 

 

0.635

 

 

I prefer to set my own criteria on which to evaluate my performance

 

 

0.612

 

 

I evaluate my own performance

 

 

0.600

 

 

I can be trusted to pursue my own learning

 

 

0.598

 

 

I prefer to set my own learning goals

 

 

0.555

 

 

I need to be in control of what I learn

 

 

0.469

 

 

I like to make decisions for myself

 

 

0.437

 

 

I need to know why

 

 

0.369

 

 

I like to evaluate what I do

 

 

0.323

 

 

I have high belief in my abilities

 

 

 

0.651

 

I am in control of my life

 

 

 

0.496

 

I am aware of my own limitations

 

 

 

0.466

 

I am assertive

 

 

 

0.408

 

I am confident in my ability to search out information

 

 

 

0.395

 

I am logical

 

 

 

0.364

 

I like to solve (answer) puzzles/questions

 

 

 

0.328

 

I can find out information for myself

 

 

 

0.307

 

I want to learn new information

 

 

 

 

0.652

I need to learn

 

 

 

 

0.472

I enjoy learning new information

 

 

 

 

0.462

I enjoy a challenge

 

 

 

 

0.361

Table 3. Rotate Component Matrix

Factors

First Survey

Second Survey

Difference of Means

t-stat

p-value

Self-management Skills

28.763

29.731

0.968

2.532

0.006**

Openness to Learning Opportunities.

72.165

73.116

0.951

2.174

0.016*

Initiative and Independence in Learning.

30.923

32.33

1.407

2.391

0.009**

Self-concept as an Effective Learner.

25.438

26.372

0.934

1.956

0.030*

Love of Learning

31.342

33.069

1.727

2.394

0.007**

* Significant at 5%; ** Significant at 1%

Table 4. Means of each survey and Comparison of Means

4. Discussion and Conclusions

The findings from this study provide valuable insights into the role of game-based learning in complex scenarios, particularly within the context of developing self-directed learning skills. The emergence of five distinct factors from the survey - Self-management Skills, Openness to Learning Opportunities, Initiative and Independence in Learning, Self-concept as an Effective Learner, Love of Learning - aligns with the multidimensional nature of learning skills that can be fostered through game-based learning, as noted by Bühler et al. (2022), Dyulicheva and Glazieva (2022), Horvat et al. (2022), and Sharma et al. (2022).

Our study revealed a significant increase in factors considered in students’ self-directed learning. This supports the existing literature on the potential of game-based learning to enhance self-directed learning skills (Taylor, 2020; Alfaro-Ponce et al., 2023; Pacheco et al., 2020; Bastos et al., 2020; Tavares, 2022). These results also align with the observations of Sharma et al. (2022) and Camacho et al. (2019), who found a positive impact of game-based learning on computational thinking, a key component of self‑directed learning.

The development of self-management skills and the students’ openness to learning opportunities, as revealed in our study, resonate with the findings of Santana (2023), Horvat et al. (2022), and Lezama et al. (2020). These studies emphasized the role of game-based learning in fostering problem-solving and lifelong learning skills, essential components of self-directed learning.

The importance of initiative and independence in learning found in our study aligns with the findings of Alfaro-Ponce et al. (2023), Tavares (2022), and Sharma et al. (2022). These studies discussed the impact of game-based learning on academic skills development and the importance of encouraging independent learning.

The self-concept as an effective learner and love of learning, which were among the factors emerging from our survey, are consistent with the research conducted by Pacheco et al. (2020), Lezama et al. (2020), Bühler et al. (2022), and Dyulicheva & Glazieva (2022). These studies highlighted the importance of creating an engaging and immersive learning environment through game-based learning, thereby fostering a positive self-concept and a love for learning.

However, while our study and the existing literature underscore the effectiveness of game-based learning, several potential avenues for future research have been suggested. These include the integration of advanced technologies into game-based learning (Sharma et al., 2022; Camacho et al., 2019), the need for longitudinal studies to understand the long-term effects of game-based learning (Pacheco et al., 2020; Bühler et al., 2022), and the exploration of the customization and personalization of game-based learning environments to cater to individual learner needs (Bastos et al., 2020; Taylor, 2020).

The results of the study highlight the numerous advantages of using simulators for learning, particularly in the field of logistics. Simulators offer a safe and controlled environment for practicing and developing skills in complex scenarios, providing immediate feedback and adaptability to individual students’ needs. They are also cost-effective and enable hands-on training, improved decision-making, reduced risk, and increased efficiency and collaboration.

The Logistics Simulator LOST proves to be particularly valuable for undergraduate students, as it allows them to experience realistic training scenarios, identify areas for improvement, and gain a better understanding of various concepts in the logistics process. These simulations contribute significantly to the skills development of students.

Moreover, the use of the LOST simulator fosters the development of SDL skills among undergraduate students. The study recognizes the importance of SDL skills in preparing students to face the complex challenges of contemporary society and the workforce in the 21st century. The factors identified in Table 1 contribute to the cultivation of essential competencies, such as self-determination in setting goals, confidence in learning abilities, openness to new learning opportunities, and a genuine desire for continuous learning.

The study also presents significant differences in students’ perception of the importance of these SDL factors, particularly at the end of the course. The emphasis on self-management of learning and interest in learning differently becomes more pronounced as students progress through the course, demonstrating the positive impact of the learning environment on SDL skill development.

However, the study acknowledges some limitations of the self-directed learning approach. Not all students may be equally capable of complete autonomy in their learning, and some may require a gradual transition towards self-directed learning. Implementing the approach might also demand more time and resources from teachers. Additionally, certain topics may require a more direct instructional approach, and assessing and validating learning outcomes in an SDL context can present challenges.

Despite these limitations, the study emphasizes the overall benefits of self-directed learning and the valuable role played by simulations in enhancing SDL skills and preparing students for the demands of an ever-changing and complex world.

Although the case has certain limitations as it is based on a sample of undergraduate logistics engineering students in Mexico, these limitations are mitigated as it is a case of application of a specific simulator designed especially for this purpose, and whose findings are generalizable to self-directed learning studies. In addition to this, the findings are promising and have implications for practice and research. Future research could aim to replicate and extend these findings in different contexts and disciplines, as suggested by Bastos et al. (2020), Lezama et al. (2020), and Sharma et al. (2022).

In conclusion, the study’s findings, in conjunction with existing literature, strongly support the use of GBL to enhance SDL skills in complex scenarios. This approach proves to be valuable in various educational contexts and disciplines. However, further research is needed to fully unlock the potential of game-based learning and refine its implementation for optimal outcomes.

Currently, the development of an advanced version of the simulator is underway through the S4L (Simulating for Learning) project. This educational platform aims to validate the development of reasoning for complexity and SDL competencies in various stakeholders, including students, academics, decision-makers, and representatives from the business sector. By integrating elements of Industry 4.0, such as cloud computing, artificial intelligence, simulation, serious games, biometrics, data analytics, and open resources, the platform seeks to train professionals who are equipped to address lifelong learning needs effectively. The significance of this platform lies in its contribution to the general welfare of society. By preparing individuals to make more informed decisions efficiently, it fosters a more competitive industry and enhances the overall decision-making processes. The platform’s potential users will have the opportunity to acquire knowledge and skills in a playful manner, observe the consequences of their decisions across different organizational areas, identify critical variables affecting real processes, and develop intrinsic motivation to explore and experiment with new strategies for problem-solving and optimization.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors acknowledge the financial support of Tecnológico de Monterrey through the “Challenge‑Based Research Funding Program 2022”. Project ID # I005 - IFE001 - C2-T3 – T.

Also, academic support from Writing Lab, Institute for the Future of Education, Tecnológico de Monterrey, México.

References

Abt, C.C. (1987). Serious games. University Press of America.

Alfaro-Ponce, B., Patiño, A., & Sanabria-Z, J. (2023). Components of computational thinking in citizen science games and its contribution to reasoning for complexity through digital game-based learning: A framework proposal. Cogent Education, 10(1), 2191751. https://doi.org/10.1080/2331186X.2023.2191751

Almeida, F., & Simoes, J. (2019). The role of serious games, gamification, and Industry 4.0 tools in the Education 4.0 paradigm. Contemporary Educational Technology, 10(2), 120-136. https://doi.org/10.30935/cet.554469

Bastos, S., Silva, M., Poza-Lujan, J.L., & KaiSchleutker (2020). A reinvented education in business and accounting using a GBL approach for soft skills. In Fotaris, P. (Ed.), Proceedings of the 14th International Conference on Game Based Learning ECGBL (55-66). Academic Conferences International. https://doi.org/10.34190/GBL.20.047

Biswas, G., Rajendran, R., Mohammed, N., Goldberg, B.S., Sottilare, R.A., Brawner, K. et al. (2020). Multilevel Learner Modeling in Training Environments for Complex Decision Making. IEEE Transactions on Learning Technologies, 13(1), 172-185. https://doi.org/10.1109/TLT.2019.2923352

Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020). Mapping research in student engagement and educational technology in higher education: A systematic evidence map. International Journal of Educational Technology in Higher Education, 17(1), 1-30. https://doi.org/10.1186/s41239-019-0176-8

Boskic, N., & Hu, S. (2015). Gamification in higher education: how we changed roles. In European conference on games-based Learning (1, 741). Academic Conferences International Limited.

Bühler, M.M., Jelinek, T., & Nübel, K. (2022). Training and Preparing Tomorrow’s Workforce for the Fourth Industrial Revolution. Education Sciences, 12(11), 782. https://doi.org/10.3390/educsci12110782

Buzady, Z., Wimmer, A., Csesznak, A., & Szentesi, P. (2022). Exploring flow-promoting management and leadership skills via serious gaming. Interactive Learning Environments, August, 1-15. https://doi.org/10.1080/10494820.2022.2098775

Camacho, C., Sahu, S., & Esteva, E. (2019). Undertaking: A business game for 21st-century undergraduate skills. In Elbaek, L., Majgaard, G., Valente, A., & Khalid, S. (Eds.), European Conference on Games Based Learning (October, 995-998). Dechema e.V. https://doi.org/10.34190/GBL.19.199

Cavicchi, C. (2021). Higher Education and the Sustainable Knowledge Society: Investigating Students’ Perceptions of the Acquisition of Sustainable Development Competences. Frontiers in Sustainable Cities, 3. Available at: https://www.frontiersin.org/articles/10.3389/frsc.2021.664505

Cecchi, L.A., Rodríguez, J.P., & Dahl, V. (2023). Logic Programming at Elementary School: Why, What and How Should We Teach Logic Programming to Children? In Lecture Notes in Computer Science (LNAI) (13900, 131-143). Springer. https://doi.org/10.1007/978-3-031-35254-6_11

Chou, P.N. (2012). The relationship between engineering students self-directed learning abilities and online learning performances: A pilot study. Contemporary Issues in Education Research (CIER), 5(1), 33-38. https://doi.org/10.19030/cier.v5i1.6784

Chris, A.E., Moldovan, A.N., Murphy, L., Pathak, P., & Muntean, C.H. (2018). Investigating flipped classroom and problem-based learning in a programming module for a computing conversion course. Journal of Educational Technology & Society, 21(4), 232-247.

Crocco, F., Offenholley, K., & Hernandez, C. (2016). A proof-of-concept study of game-based learning in higher education. Simulation & Gaming, 47(4), 403-422. https://doi.org/10.1177/1046878116632484

Cruz-Martinez, G., Soto, Ó., & Benito, A. B. (2022). Learning about political systems while playing: Testing short-term knowledge retention through a role-play classroom game. Revista Española de Ciencia Política, 60, 53-83. https://doi.org/10.21308/recp.60.02

Czauderna, A., Guardiola, E., Lux, J.D., & Budke, A. (2021). How insights into entertainment games can improve the design of educational games on complex societal problems. In Fotaris, P. (Ed.), Proceedings of the 15th European Conference on Games Based Learning (September, 170-177). Dechema e.V. https://doi.org/10.34190/GBL.21.119

Dyulicheva, Y.Y., & Glazieva, A.O. (2022). Game based learning with artificial intelligence and immersive technologies: An overview. In Kiv, A.E., Semerikov, S.O., Soloviev, V.N., & Striuk, A.M. (Eds.), CEUR Workshop Proceedings (3077, 146-159). CEUR-WS. Available at: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85123793902&partnerID=40&md5=7d62a3125997d6d1ac70765bf662cb14

Fisher, M., King, J., & Tague, G. (2001). Development of a self-directed learning readiness scale for nursing education. Nurse Education Today, 21(7), 516-525. https://doi.org/10.1054/nedt.2001.0589

Garrison, D.R. (1997). Self-directed Learning: Toward a comprehensive model. Adult Education Quarterly, 48(1), 18-33. https://doi.org/10.1177/074171369704800103

Gaurav, D., Kaushik, Y., Supraja, S., Yadav, M., Gupta, M.P., & Chaturvedi, M. (2022). Empirical Study of Adaptive Serious Games in Enhancing Learning Outcome. International Journal of Serious Games, 9(2), 27‑42. https://doi.org/10.17083/ijsg.v9i2.486

Haendler, T. (2019). A card game for learning software-refactoring principles. In Arnedo-Moreno, J., Gonzalez, C.S., & Mora, A. (Eds.), CEUR Workshop Proceedings (2497). CEUR-WS. Available at: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85075099301&partnerID=40&md5=2b8e41a26dd9d25614b783c60212c4dd

Hainey, T., Baxter, G., & Ford, A. (2020). An evaluation of the introduction of games-based construction learning in upper primary education using a developed game codification scheme for scratch. Journal of Applied Research in Higher Education, 12(3), 377-402. https://doi.org/10.1108/JARHE-02-2018-0031

Hallros, P., & Pålsson, N. (2021). Simulating a system: Using video games as tools to promote self‑directed learning. Master thesis.

Hansen, R.E., & Elbæk, L. (2019). Educating for the 21st century with role play in event design. In Elbaek, L., Majgaard, G., Valente, A., & Khalid, S. (Eds.), Proceedings European Conference on Games Based Learning (October, 317-324). Dechema e.V. https://doi.org/10.34190/GBL.19.117

Herrera, L.M.M., & Valenzuela, J.C.M. (2019). What kind of teacher achieves student engagement in a synchronous online model? In 2019 IEEE Global Engineering Education Conference (EDUCON) (227-231). IEEE. https://doi.org/10.1109/EDUCON.2019.8725208

Horvat, M., Jagust, T., Veseli, Z.P., Malnar, K., & Cizmar, Z. (2022). An overview of digital game-based learning development and evaluation models. In Vrcek, N., Koricic, M., Gradisnik, V., Skala, K., Car, Z., Cicin-Sain, M. et al. (Eds.), Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO) (717-722). Opatija, Croatia. https://doi.org/10.23919/MIPRO55190.2022.9803333

Hubl, A., & Fischer, G. (2017). Simulation-Based Business Game for Teaching Methods in Logistics and Production. In Chan, V., Dambrogio, A., Zacharewicz, G., & Mustafee, N. (Eds.), 2017 Winter Simulation Conference (WSC), 4228-4239. Available at: https://www.webofscience.com/wos/woscc/full-record/WOS:000427768604039 https://doi.org/10.1109/WSC.2017.8248129

Kivunja, C. (2014). Do You Want Your Students to Be Job-Ready with 21st Century Skills? Change Pedagogies: A Pedagogical Paradigm Shift from Vygotskyian Social Constructivism to Critical Thinking, Problem Solving and Siemens’ Digital Connectivism. International Journal of Higher Education, 3(3), 81-91. https://doi.org/10.5430/ijhe.v3n3p81

Knowles, M.S. (1975). Self-directed Learning: A guide for learners and teachers. Association Press, 291 Broadway, New York, New York

Laamarti, F., Eid, M., & El-Saddik, A. (2014). An overview of serious games. International Journal of Computer Games Technology, 2014, Article ID 358152. https://doi.org/10.1155/2014/358152

LeBlanc, P.J. (2018). Higher education in a VUCA world. Change: The Magazine of Higher Learning, 50(3-4), 23-26. https://doi.org/10.1080/00091383.2018.1507370

Lezama, O.B.P., Manotas, E.N., & Mercado-Caruzo, N. (2020). Analysis of design patterns for educational application development: Serious games. Procedia Computer Science, 175, 641-646. https://doi.org/10.1016/j.procs.2020.07.093

Lindberg, S. (2019). Gamification for Self-Directed Learning in Higher Education. EDULEARN19 Proceedings (1764-1773). https://doi.org/10.21125/edulearn.2019.0507

Lutz, H., & Birou, L. (2013). Logistics education: a look at the current state of the art and science. Supply Chain Management: An International Journal, 18(4), 455-467. https://doi.org/10.1108/SCM-08-2012-0269

Luu, T.M.V. (2022). Readiness for Online Learning: Learners’ Comfort and Self-Directed Learning Ability. International Journal of TESOL & Education, 2(1), 213-224. https://doi.org/10.54855/ijte.222113

Mahmoud, R.V., Kidmose, E., Broholm, R., Pilawka, O.P., Illés, D., Magnussen, R. et al. (2020). Attack and defend: Combining game-based learning with virtual cyber labs. In Fotaris, P. (Ed.), International Conference on Game Based Learning ECGBL (364-371). Academic Conferences International. https://doi.org/10.34190/GBL.20.150

Minciu, M., Berar, F.A., & Dobrea, R.C. (2020). New decision systems in the VUCA world. Management & Marketing, 15(2), 236-254. https://doi.org/10.2478/mmcks-2020-0015

Neves, J.C., & Sousa, C. (2019). Developing pedagogical videogames to support math learning in deaf children: A work in progress (phases 1-3). In Elbaek, L., Majgaard, G., Valente, A., & Khalid, S. (Eds.), ECGBL 2019 — 12th International Conference on Game Based Learning (October, 1019-1023). Dechema e.V. https://doi.org/10.34190/GBL.19.169

Pacheco-Velázquez, E. (2015), The use of business simulators in teaching logistics. International Conference on Interactive Collaborative and Blended Learning (ICBL) (27-60). https://doi.org/10.1109/ICBL.2015.7387634

Pacheco-Velazquez, E. (2022). Effects of the use of simulators and an online platform in logistics education. International Journal on Interactive Design and Manufacturing (IJIDeM) (1-19). https://doi.org/10.1007/s12008-021-00791-z

Pacheco-Velázquez, E.A., & Aguilar-Avalo, M. (2019). GOAL: Generating Learning Opportunities in Logistics. In 2019 IEEE Global Engineering Education Conference (EDUCON) (761-769). IEEE. https://doi.org/10.1109/EDUCON.2019.8725075

Pacheco-Velazquez, E.A., & Viscarra-Campos, S.M. (2019). Exploring critical factors related to reflection, engagement, and self-directed learning. In 2019 IEEE Frontiers in Education Conference (FIE) (1-8). IEEE. https://doi.org/10.1109/FIE43999.2019.9028546

Pacheco, E., & Palma-Mendoza, J. (2021). Using Serious Games in Logistics Education. In 2021 The 2nd International Conference on Industrial Engineering and Industrial Management (51-55). https://doi.org/10.1145/3447432.3447438

Pacheco, E., Palma, J., Salinas, D., & Arana, I. (2020). Gamification and self-directed learning. In ECGBL 2020 14th European Conference on Game-Based Learning (417). Academic Conferences.

Payne, K., Keith, M.J., Schuetzler, R.M., & Giboney, J.S. (2017). Examining the learning effects of live streaming video game instruction over Twitch. Computers in Human Behavior, 77, 95-109. https://doi.org/10.1016/j.chb.2017.08.029

Pogge, E.K., & Davis, L.E. (2021). Fostering Mindfulness in Continuing Pharmacy Education Using a Board Game: Initial Experiences and Perceptions. Journal of Continuing Education in the Health Professions, 41(3), 230-233. https://doi.org/10.1097/CEH.0000000000000351

Prihastiwi, W.J., Prastuti, E., & Eva, N. (2021). E-Learning readiness and learning engagement during the Covid-19 pandemic. KnE Social Sciences, 4(15), 236-243. https://doi.org/10.18502/kss.v4i15.8212

Prompolmaueng, W., Wetmaha, A., & Jamsri, P. (2021). A Game Development to Promote Computational Thinking. 13th International Conference on Information Technology and Electrical Engineering (ICITEE) (116-121). https://doi.org/10.1109/ICITEE53064.2021.9611850

Qian, M., & Clark, K.R. (2016). Game-based learning and 21st-century skills: A review of recent research. Computers in Human Behavior, 63, 50-58. https://doi.org/10.1016/j.chb.2016.05.023

Ramírez-Montoya, M.S., Castillo-Martínez, I.M., Sanabria-Zepeda, J.C., & Miranda, J. (2022). Complex Thinking in the Framework of Education 4.0 and Open Innovation—A Systematic Literature Review. Journal of Open Innovation: Technology, Market, and Complexity 8(1), 4. https://doi.org/10.3390/joitmc8010004

Rosenthal, S., & Ratan, R.A. (2022). Balancing learning and enjoyment in serious games: Kerbal Space Program and the communication mediation model. Computers & Education, 182, 104480. https://doi.org/10.1016/j.compedu.2022.104480

Rumeser, D., & Emsley, M. (2019). Can Serious Games Improve Project Management Decision Making Under Complexity? Project Management Journal, 50(1), 23-39. https://doi.org/10.1177/8756972818808982

Salinas-Navarro, D.E., Pacheco-Velazquez, E., Arana-Solares, I., & Palma-Mendoza, J. (2020). Gamification and Self-Directed Learning. Proceedings of the European Conference on Games-based Learning. https://doi.org/10.34190/GBL.20.159

Sánchez, A.Y.L., & Lara, A.L.G. (2021). Assessment of a serious game that may contribute to improving logical-mathematical reasoning in high school students. RIED-Revista Iberoamericana de Educación a Distancia, 24(1), 221-243. https://doi.org/10.5944/ried.24.1.27450

Santana, O.A. (2023). Problem-Solving and Lifelong Learning: Engineering Students versus Retired Engineers with Dementia. In Rocha-Brito, C. & Ciampi, M.M. (Eds.), IEEE World Engineering Education Conference (EDUNINE). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/EDUNINE57531.2023.10102813

Scott, C.L. (2015). The Futures of learning 2: What kind of learning for the 21st century? - UNESCO Digital Library. UNESCO. Available at: https://unesdoc.unesco.org/ark:/48223/pf0000242996

Sevcenko, N., Ninaus, M., Wortha, F., Moeller, K., & Gerjets, P. (2021). Measuring Cognitive Load Using In-Game Metrics of a Serious Simulation Game. Frontiers in Psychology, 12 (March), 572437. https://doi.org/10.3389/fpsyg.2021.572437

Sharma, V., Bhagat, K.K., Huang, H.H., & Chen, N.S. (2022). The design and evaluation of an AR-based serious game to teach programming. Computers and Graphics (Pergamon), 103, 1-18. https://doi.org/10.1016/j.cag.2022.01.002

Sincharoenkul, K., Tongtep, N., & Boonlamp, L. (2020). Supervised Classification of Board Games for Active Learning to Enhance Business Knowledge and Skills. 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (665-668). https://doi.org/10.1109/ECTI-CON49241.2020.9158301

Sun, L., & Song, G. (2018). Current state and future potential of logistics and supply chain education: a literature review. Journal of International Education in Business., 11(2), 124143. https://doi.org/10.1108/JIEB-10-2017-0039

Tavares, N. (2022). The use and impact of game-based learning on the learning experience and knowledge retention of nursing undergraduate students: A systematic literature review. Nurse Education Today, 117, 105484. https://doi.org/10.1016/j.nedt.2022.105484

Taylor, S. (2020). Designing an augmented reality-enabled smartphone campus guide learning game. In Fotaris, P. (Ed.), European Conference on Games Based Learning (604-612). Dechema e.V.. https://doi.org/10.34190/GBL.20.065

Tekkol, İ.A., & Demirel, M. (2018). An investigation of self-directed learning skills of undergraduate students. Frontiers in Psychology, 9, 2324. https://doi.org/10.3389/fpsyg.2018.02324

Toh, W., & Kirschner, D. (2020). Self-directed learning in video games, affordances and pedagogical implications for teaching and learning. Computers & Education, 154, 103912. https://doi.org/10.1016/j.compedu.2020.103912

Tseng, C.Y., Doll, J., & Varma, K. (2019). Exploring evidence that board games can support computational thinking. In Kong, S.C., Sin, K.F., Andone, D., Biswas, G., Hoppe, H.U., Hsu, T.C. et al. (Eds.), Proceedings of International Conference on Computational Thinking Education (61-64). The Education University of Hong Kong. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85093103248&partnerID=40&md5=d857c563e4439e4d15e04faf2d02a430

van Laar, E., van Deursen, A.J., van Dijk, J.A., & de Haan, J. (2020). Determinants of 21st-century skills and 21st-century digital skills for workers: A systematic literature review. Sage Open, 10(1), 2158244019900176.

Wong, H.K.M., & Mok, I.C. (2019). Students’ Mathematics Experience of the Technology Self-Directed Learning (tsdl) Pedagogy. In Chova, L.G., Martinez, A.L., & Torres, I.C. (Eds.), 12th International Conference of Education, Research and Innovation (ICERI 2019) (1614-1623). Iated-Int Assoc Technology Education & Development. https://www.webofscience.com/wos/woscc/full-record/WOS:000530109201106 https://doi.org/10.21125/iceri.2019.0459

Zhang, K., Gao, L., Chen, J., Liu, X., Wang, G., & Liao, M. (2020). Eye-Tracking Analysis of Autistic Children’s Attention to Social Stimuli. In Wang, F.L., Au, O., Piamsa-nga, P., Lee, L.K., & Anussornnitisarn, P. (Eds.), International Symposium on Educational Technology (ISET) (268-272). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ISET49818.2020.00065

Zhonggen, Y. (2019). A meta-analysis of the use of serious games in education over a decade. International Journal of Computer Games Technology, 2019(February), 1-8. https://doi.org/10.1155/2019/4797032




Licencia de Creative Commons 

This work is licensed under a Creative Commons Attribution 4.0 International License

Journal of Technology and Science Education, 2011-2024

Online ISSN: 2013-6374; Print ISSN: 2014-5349; DL: B-2000-2012

Publisher: OmniaScience