Characterizing the Serious Game and Assessing Learning Goals
Keywords:
Serious game, assessment grid, learning objective, learning outcomes, effectiveness, performance, satisfaction, design science, higher educationAbstract
Serious games (SGs) are video or computer games designed for training or educational purposes. Thanks to the wide variety of opportunities they provide, e.g. interactivity, immersion, simulation, etc they have become universally embraced in both academic and non-academic fields alike. However, the selection of the most suitable SG with regard to a given learning goal seems to be less well addressed in the literature. This paper tries to bridge this research gap by building a new Characterizing and Assessing Serious Games Grid (CASGG). The research was based on a design science method. The CASGG was built during a series of meetings (i.e. working group with professionals (education experts), brainstorming with students and teachers) and pilot tests with students. Subsequently, it was tested in the higher education field with 41 graduate students to assess their learning performance according to leaning goals using a specific SG. The tested SG was StarBank the Game and the learning goal was to understand the principal mechanisms of banking. The findings revealed that there is no difference in terms of learning performance between students who have used the SG and those who have followed the theoretical course. With reference to learning satisfaction, the first category of students expressed much more enthusiasm and motivation for learning. Using the SG was for them more enjoyable and engaging. The game play succeeded in capturing their attention, challenging their curiosity and enhancing their interest in the theoretical knowledge.
Moreover, owing to this research the design science approach proved most suitable for the building and application of the CASGG by demonstrating its practical feasibility and use. Regarding the context of SGs, the CASGG is actually not only an empirical elaboration of an SG assessment instrument, but also a starting point for further research in this area.
References
Abt, C. (1970). Serious Games, New York: The Viking Press.
Agarwal, R. and Karahanna, E. (2000). Time flies when you're having fun: Cognitive absorption and beliefs about information technology usage, MIS Quarterly, 24, 4, 665-694.
Alexander, P. A., Jetton, T. (2000). “Learning from text: A multidimensional and developmental perspective.” In: Kamil, M. L. Mosenthal, P. B., Pearson, P. D., Barr, R. (eds.), Handbook of reading research, Vol. 3, pp. 285-310. Mahwah, NJ: Erlbaum.
Alvarrez J. (2007). Du jeu vidéo au Serious Game : Approches culturelle, pragmatique et formelle, Thèse de doctorat, Université de Toulouse.
Bandura, A. (1986). Social Foundations of Thought and Action: A Social Cognitive Theory, NJ: Prentice-Hall: Englewood Cliffs.
Bhattacherjee, A. (2001). Understanding Information Systems Continuance: an Expectation-Confirmation Model. MIS Quarterly, 25(3), 351–370.
Boughzala I., Bououd I., Michel H. (2013). Characterization and Evaluation of Serious Games: A perspective of their use in higher education, Proceedings of the 46th Hawaii International Conference on System Sciences (HICSS 46), IEEE Computer Society, January 7-10, 2013, Maui, USA.
Briggs, R. O., Vreede, G. J., de, Nunamaker, Jr., J. F. (2003). Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems. Journal of Management Information Systems, 19, 31-64.
Choi, D. H., Kim, J. and Kim, S. H. (2007). ERP training with a Web-based electronic learning system: The flow theory perspective, International Journal of Human-Computer Studies, 65, 223-243.
Collinson, E. 2000. “A Survey of Elementary Students’ Learning Style Preferences and Academic Success,” Contemporary Education (71:4), p. 42.
Csikszentmihalyi, M. (1975). Play and intrinsic rewards, Journal of Humanistic Psychology, 15, 3, 41-63.
Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience, Harper & Row, Publishers, New York.
Davis, F., (1989), Perceived usefulness, perceived ease of use and user acceptance of information technology, MIS Quarterly, Vol. 13, N° 3, September, pp. 318-340.
Deci, E. L., Ryan, R. M. (1985). The general causality orientations scale: Self-determination in personality. Journal of Research in Personality, 19, 109–134.
Djaouti, D. J. A., Jessel J. P. (2011). Classifying Serious Games: The G/P/S Model, Patrick Felicia (ed), "Handbook of Research on Improving Learning and Motivation through Educational Games: Multidisciplinary Approaches", IGI Global.
Ellis, H., Heppel, S., Kirriemuir, J., Krotoski, A., McFarlane, A. (2006). "Unlimited Learning: Computer and Video Games in the Learning Landscape." Accessed March, 2014, from http://www.org.id.tue.nl/IFIP-TC14/documents/ELSPA-report-2006.pdf
Felder R. M., Silverman, L. K. and Solomon, B. A. (1996). “Index of learning styles (ILS),” Available on line: http://www.ncsu.edu/felder-public/ILSpage.html.
Felder, R., and Silverman, L. 1988. “Learning styles and teaching styles in engineering education,” Engineering Education (78:7), pp. 674–681.
Flowerday, T., Schraw, G., Stevens, J. (2004). The role of choice and interest in reader engagement. Journal of Experimental Education, 72, 93–114.
Gee, J. P. (2007). "Are video games good for learning?" Curriculum Leadership 5(1).
Hevner, A., March, S., Park, J., and Ram, S (2004). "Design Science in Information Systems Research." MIS Quarterly 28(1): 75-105.
Hidi, S., Baird, W. (1986). Interestingness-A neglected variable in discourse processing. Cognitive Science, 10, 179-194.
Holbrook, M. B., & Hirschman, E. C. (1982). The experiential aspects of consumption: consumer fantasies, feelings, and fun. Journal of consumer research, 132–140.
Kebritchi, M., Hirumi, A. & Bai, H., (2010). “The effects of modern mathematics computer games on mathematics achievement and class motivation”, Computers & education 55(2): 427-443.
Kintsch,W. (1980). Learning from text, levels of comprehension: Why anyone would read a story anyway. Poetics, 9, 87–89.
Kirkpatrick, D.L. (1994). Evaluating Training Programs: The Four Levels. San Francisco, CA: Berrett-Koehler
Kolb, D. (1984). Experiential Learning: experience as the source of learning and development, NJ: Prentice Hall: Englewood Cliffs.
Koufaris, M. (2002). Applying the technology acceptance model and flow theory to online consumer behavior, Information Systems Research, 13, 2, 205-223.
Krapp, A., Hidi, S. Renninger K. A. (1992). Interest, learning, and development. In: Renninger, K. A., Hidi, S., Krapp, A. (eds.), The role of interest in learning and development, pp. 3- 25, Hillsdale, NJ: Erlbaum.
March, S. T. and Smith, G. (1995). Design and Natural Science Research on Information Technology, DecisionSupport Systems (15:4), December 1995, pp. 251-266.
Michel H., Kreziak D., Héraud J-M., (2010). Evaluation de la performance des Serious Games, pour l’apprentissage : Analyse du transfert de comportement des éleveurs virtuels de Vacheland, Système d’Information Management 14(4).
Mitchell, A., Savill-Smith, C. (2004). "The Use of Computer and Video Games for Learning: A Review of the Literature." Accessed March, 2014, from http://dera.ioe.ac.uk/5270/1/041529.pdf
Mitchell, T. R. (1982). Motivation: New directions for theory. Academy of Management Review, 7, 80–88.
Paulk, M., Curtis, B., Chrissis, M. and Weber, C. (1993, February). Capability maturity model for software, Version 1.1. Technical Report CMU/SEI-93-TR-024 ESC-TR-93-177.
Peterson, R.I. V., J. Herrington (2008). Standards for educational, edutainment, and developmentally beneficial computer games. World Conference on Educational Multimedia. Vienna, Austria.
Petty R. E., Cacioppo, J. T., (1984). "The Elaboration Likelihood Model Of Persuasion." Advances in Consumer Research 11.
Pfeffer, J., Sutton, R. (2000). The knowing-doing gap, Boston, MA: Harvard Business School Press.
Philips J. (2003). Return on Investment in Training and Performance Improvement Programs, 2nd Edition, Jack J. Philips, Butterworth-Heinemann, Burlington, MA.
Prensky M. (2001a). Digital game-based learning. New York:McGraw-Hill.
Prensky, M. (2001b). Digital Natives, Digital Immigrants Part 1. On the Horizon on the Horizon, 9, 5, 1–6.
Prince, M. (2004). Does Active Learning Work? A Review of the Research, Journal of Engineering Education, 93(3): 223–231.
Rieber, L.P. 1996. "Seriously Considering Play: Designing Interactive Learning Environments Based on the Blending of Microworlds, Simulations, and Games," Educational Technology Research & Development (44:2), pp. 43-58.
Rooney, P. (2007). Students @ play: serious games for learning in higher education, International Technology, Education and Development.
Ryan, R.M., Deci E.L. (2000). Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being. American Psychologist, 55, 1, 68-78.
Schiefele, U. (1999). Interest and learning from text. Scientific Studies Reading, 3, 257–280.
Schraw, G., Lehman, S. (2001). Situational interest: A review of the literature and directions for future research. Educational Psychology Review, 13, 23–53.
Scientists, F. o. A. (2005). Harnessing the Power of Video Games for Learning, Proceedings of the Summit on Educational Games.
Tobias, S. (1994). Interest, prior knowledge, and learning. Review of Educational Research, 64, 37-54.
Tomorrow P. (2008). "Speak Up 2007 for Students, Teachers, Parents & School Leaders Selected National Findings".
Ulicsak, M. (2010). "Games in Education: Serious Games." Accessed March, 2014, from http://media.futurelab.org.uk//resources/documents/lit_reviews/Serious-Games_Review.pdf
Venkatesh, V., Morris, M.G., Davis, G.B., Davis, F.D., (2003). User Acceptance of Information Technology: Toward a unified view, Management Information Systems (MIS) Quarterly, Vol. 27, N° 3, pp. 425-478.
Vreede, G. J. de, Briggs, R., Massey, A., (2009). Collaboration Engineering: Foundations and Opportunities”, Journal of the AIS, vol. 10, no. 3, p. 121-137.
Wade, S. E. (1992). How interest affects learning from text. In: Renninger, A., Hidi, S., Krapp, A. (eds.), The role of interest in learning and development, pp. 255-277, Hillsdale, NJ: Erlbaum.
Zyda M. (2005). “From Visual Simulation to Virtual Reality to Games”. Computer Vol.38, N° 9, pp 25-32.
Downloads
Published
How to Cite
Issue
Section
License
The author bears the responsibility for checking whether material submitted is subject to copyright or ownership rights (e.g. figures, tables, photographs, illustrations, trade literature and data). The author will need to obtain permission to reproduce any such items, and include these permissions with their final submission.
It is our policy to ask all contributors to transfer for free the copyright in their contribution to the journal owner. There are two broad reasons for this:
- ownership of copyright by the journal owner facilitates international protection against infringement of copyright, libel or plagiarism;
- it also ensures that requests by third parties to reprint or reproduce a contribution, or part of it, in either print or electronic form, are handled efficiently in accordance with our general policy which encourages dissemination of knowledge within the framework of copyright.
In conformity with the French law, the author keeps the 'moral rights' related to the article:
- The 'authorship right': It is the author's right to have his name associated with each publication and exploitation of the article.
- The 'integrity right': It can be claimed by the author if he finds that during an exploitation, his work has been distorted (cutting, reassembly...).
