Header Image - Latest Blogs...

The Kirkpatrick Model: Level 2

THE STRUCTURE OF DIFFERENT MODELS

As a prelude to discussing Level 2, let’s take a quick step back to look at the structure of different Instructional Design Models (IDM). Any reader will find numerous different models; common among all of them, though, is the differentiation of the evaluation process into different components or levels. Some of the models have a minimal number of components, whereas others have seven or so. What’s going on here? It’s not difficult to understand when comparing different models. The creators of a given IDM might extrapolate a single component into two or more. The number of components bares notice as they signify the structure of the learning process. In other words, the structure conveys a cognitive schematic for appreciating educational design and evaluation, not simply an expanded PowerPoint that assists students in their learning.

The original Kirkpatrick Model utilized four components, or as they put it, levels. The fact that they used the concept of “levels” to depict the evaluation process is significant, as the original schematic depicted the evaluation process as different levels of a pyramid with the final level on the top. Such a schematic is hierarchical in its structure. The New World Kirkpatrick Model (NWKM) still utilizes four levels, however, instead of a pyramid, the NWKM utilizes links in a chain to depict the cognitive schematic. The notion of a “chain” signifies a connected process, with each link, or level, having an impact on the next. One might surmise that the NWKM still terms each component as a “level” to create continuity with the original model.

LEVEL 2: LEARNING

With our review of the Kirkpatrick Level 2, let’s begin by inspecting how the “links,” that is, Level 1 and Level 2, are connected. To recall, Level 1 deals with the concept of Reaction with the intent on evaluating customer satisfaction. The NWKM identified three dimensions of Level 1: the degrees to which the training was favorable, engaging, and relevant. Level 2 deals with the concept of Learning. Clearly, and this is common sense, the ability—or even desire—to learn is predicated on and “linked” with a student’s initial reaction to the training. In short, if a student’s reaction to the training is negative, there is no incentive for active listening, participation, and overall motivation for content retention.

There are three dimensions of the original Kirkpatrick Model and two additional ones for the NWKM: knowledge, skill, attitude, confidence, and commitment (www.kirkpatrickpartners.com ).

A. Knowledge

  • Knowledge is the foundation of cognitive learning; this part is hierarchical and based educational content. Knowledge is content based regardless of whether the information is conveyed in textual, pictorial, or through a hands-on demonstration. This dimension is familiar to most: “Mom, I received a 91% on test!” The depth of knowledge is another element, which begins to blend into the matter of skill.

B. Skill

  • A student may know how to perform a task, however, that is quite different from having the skill to perform the task.  For example, knowing how to solder and wire a circuit board is very different than doing it oneself; similarly, it is different to know all of the rules in soccer versus having the skill to be a referee. In the former case, skill is a tangible manipulation, whereas in the latter case, skill is a matter of cognitive interpretation. In both cases, the learning process includes skill, the operationalization of knowledge.

C. Attitude

  • A learner’s “attitude” toward training is predicated upon her/his value judgment about the utility of the new practice and/or process. The trainer and learner may agree that the course material is “relevant” to the work of the learner (Level 1). However, the learner may disagree in its value. For example, he/she may find the knowledge to be incomplete or simply incorrect. Second, he/she may find the skill required is too complicated or simplistic. A positive attitude toward the training requires an appreciation of the knowledge and the required associated skills.

D. Confidence

  • Confidence is linked to attitude. If students are positively disposed toward the knowledge and skill, then they will need confidence to perform the task.  This is an essential, perhaps, pivotal dimension of the training. Everything can be completely in place, including our next element, commitment, but if students lack confidence, they falter in their ability to place the training into practice. To facilitate confidence, course administrators and trainers need to be conscious that prior elements in learning—knowledge and skill—are clearly and completely detailed and depicted. Given that trainers are the functional experts compared to their students, they must be certain not to skip over elements they take for granted.

E. Commitment

  • This NWKM dimension is a sibling of confidence. Since learning is a process, having a commitment is essential, because few of us “get it right” in the beginning stages of trying out a new way of doing things. The student must be committed in light of failure and not fall back on the old way of doing things thinking “well, at least that worked.”

The NWKM envisions learning (Level 2) as a longer process separate from the traditional didactic of knowing facts. In this context, learning is far more dynamic and dependent upon on the trainer to create a vision for the material and empower the students to take educational ownership.

Next week we’ll look at Level 3: Behavior.

Craig Lee Keller, Ph.D., JAG Learning Strategist

The Kirkpatrick Levels: Background & Context

When discussing the Flipped Classroom last year, we ended our four-part discussion with an appreciation of how to measure its effectiveness. Several ways of evaluating trainings were identified including informal feedback from students and formal assessments of content mastery among others. Our discussion was intended to offer different ways for to evaluate trainings from various perspectives.

As you probably guessed, a well-developed field exists to evaluate courses, educational techniques, and training approaches: Instructional Design Models (IDM). There is a range of IDMs, but the best-known model is the Kirkpatrick Model.

BACKGROUND

Donald L. Kirkpatrick developed the Kirkpatrick Model, which was based on his 1954 dissertation, and later serialized in the US Training and Development Journal, the organ for the American Society for Training and Development (ASTD). In 1994, he and his son, James D. Kirkpatrick, published Evaluating Training Programs, which provided a complete and formal foundation and basis for his original ideas. Kirkpatrick with the assistance of his son and daughter, Wendy K. Kirpatrick, founded the business enterprise Kirkpatrick Partners, to offer consulting, products, and various events and training based on the “one and only Kirkpatrick” model. Donald passed away in 2014, but his children continue promoting the Kirkpatrick model, and James Kirkpatrick, who also has a doctorate, created the New World Kirkpatrick Model, which adds additional facets to each of the four levels for evaluating trainings.

MODEL STRUCTURE

The following four elements constitute the basis for the Kirkpatrick Model: Reaction, Learning, Behavior, and Results. Kirkpatrick originally used a pyramid schematic to visualize his concepts, but the Kirkpatrick Partners on their website currently use the image of interconnected links of a chain. Each level progressively leads to the next and is best understood as the straightforward definition of the level’s name.

LEVEL 1: REACTION

The basic understanding for level one is simple: how did training participants react to the training? This is a simple method for appreciating customer satisfaction. Or as described on its website: “the degree to which the participants find the training favorable, engaging, and relevant to their jobs.” The New World Kirkpatrick Model (NWKM) added the latter two elements. They describe engagement as the following: “The degree to which participants are involved in and contributed to the learning experience.” Similarly, relevance is described as the following: “The degree to which training participants will have the opportunity to use or apply what they learned in the training on the job.”

A. Reaction Sheets/Smile Sheets

The basic means of determining reaction is the use of “smile sheets,” otherwise known as a survey of participants’ reactions. Such a survey, generally speaking, is handed out and completed just after the training using paper and pencil or on-line.

B. Survey Questions

Most surveys query participants about a number of the training facets. What is the facility like? Was the facility located in a convenient place? Did the training start on time? Were the training goals clearly outlined? Were the training materials helpful? Was the facilitator knowledgeable? Did you like the facilitator’s style? Were there a sufficient number of breaks during the training? Was the content relevant to your work?

Training participants are prompted to answer each question in either a binary yes/no fashion or rate the response along a scale (Likert Scale). The distinctive element of these questions is that the focus is on the training and the trainer.

C. NWKM Shift of Focus

Jim Kirkpatrick realized that there was something missing in the traditional Kirkpatrick Model. He realized the surveys were self-centered around the environment and themselves: their facility, their course, and their trainer.

The NWKM remodeled the smile sheets to be “learner-centered.” As noted in their training material, instead of the training-centered category “The program objectives were clearly defined,” the learning-centered category is “I understood the learning objectives.”

Jim Kirkpatrick believes, most importantly, that this level needs to be tied to the last two levels, behavior and performance. That is, the NWKM is structured and functions to reinforce or stimulate positive on-the-job practices, which in turn directly impact organizational goals. He notes that the since the “smile sheets” generally are training-centered that they create a perception for training participants that are anchored between the participant and her/his job. Rather, the training needs to be learner-centered in a manner that links the participant to the organizational goals through their jobs.

Next week we’ll look at Level 2: Learning.

Craig Lee Keller, Ph.D., JAG Learning Strategist

Sources:

http://educationaltechnology.net/

http://www.kirkpatrickpartners.com/

 

Trends 2017: mLearning

One of the big trends over the past few years is mLearning: Mobile Learning. As a subset of eLearning, mLearning is defined by the utilization of mobile devices: laptops, tablets, smart phones, and smart watches. Isn’t this just the same thing we’ve been talking about? As is often the case, yes and no. The platform for eLearning is simply the vehicle for delivering content; the platform in that context is irrelevant. Though one could immediately rank the ease of use for accessing an Internet portal between, say, a desktop computer and a smart watch. The power behind mLearning is not the mobile platform per se; the power of the various platforms is associated with how each is integrated into our increasing mobile personal and professional lives.

BACKGROUND: THE MOBILIZATION OF MEDIUMS

For our film aficionados, many will recall the scene from Annie Hall where the characters played by Woody Allen and Diane Keaton are waiting for movie tickets only to be verbally assaulted by a person loudly expounding to his date the ideas of media guru Marshall McLuhan. After a short vitriolic argument, Allen draws forth Marshall McLuhan from behind a cardboard sign with the latter pronouncing that the loud bombast knew nothing of his ideas. In addition to a lesson in personal civility and avoiding humiliation, this vignette prompts one to investigate McLuhan’s ideas.

McLuhan’s best-known work is the book The Medium is the Message. Many intuitively translate its meaning to the following interpretation of the title: a given medium, for example, television, is superficial, so therefore messages from that medium are superficial. On a crude level, such an interpretation is interesting, but is entirely separate from McLuhan’s main argument. He argued that the medium for transmitting information does not per se impact the interpretation of the information; rather, “the ‘message’ of any medium or technology is the change of scale or pace or pattern it introduces into human affairs.” McLuhan employs the example of the railway to argue his point. The railway does not create “transportation,” though “it accelerated and enlarged the scale of previous human functions, creating totally new kinds of cities and new kinds of work and leisure.” The same, for that matter, can be argued about the uniform standardization of time, which facilitated commerce.

THE IMPACT OF MOBILE TECHNOLOGY

  • Oh how we love our technology! Let me (and us) count the ways!
    • Remote Access
    • Centralization and Integration of Tasks
    • Expansion of Possibilities
    • Technological Independence versus Interdependence
    • Remote Monitoring and Supervision
    • ???????? . . . ????????
    • What are your ideas?

 

Instead of going into great detail about any of these issues, let’s just pause for a moment and think about a single change it has generated in our lives.

If you’re old enough, remember the time when children—or the vast majority of adults—did not have cell phones. When working as a contractor in the defense industry, a colleague shared with me his disgust of a very select number of individuals who used their bulky cell phones while waiting in rush hour traffic. At this time, virtually nobody had cell phones due to the cost or the perceived need. To mock those individuals, he tied a plastic child’s phone to his rear view mirror and used it when aside one of Washington’s movers and shakers in earnest conversation.

The introduction of mobile technology has vastly revolutionized our collective personal and professional lives (and psyches). Before one might have to track down a payphone to inform a colleague he or she was going to be late to a meeting due to traffic; now one simply calls using their cell phone—hands free, mind you! One could spend pages if not books discussing the implications of the transformations of our lives due to mobile technology.

Now, truly, it’s hard to imagine life without a smart phone no less a cell phone in general. If one does not have one, then the most common response is to reflexively judge that the non-use is either old or has something wrong with her or him. It’s not surprising with this overwhelming system of belief that a backlash has arisen sponsoring an array of products favoring “slow” living.

IMPACT ON EDUCATION: mLearning

O.K.! We’re back to mLearning!! So how has the advent of mobile technology changed the “scale or pace or pattern” of education? Like eLearning, the advent of mobile technology has further de-centered the classroom from a fixed site. Instead of coming to the “one-room classroom” governed in style and content by an instructor, mobile technology has added a variety of different sources for content and platforms for accessing it. Moreover, the variety of sources has empowered learners to question and challenge the value of received content from their instructors. In short, the ease of accessing information has impacted the student-teacher dynamic and has impacted, more importantly for our purposes, the style of learning, which is no longer classroom-centered.  

To begin to appreciate the impact of mLearning, one only needs to recall the dynamics of the “Flipped Classroom.” Yet, mLearning has a number of facets not present in the “standard” flipped classroom.

A. The Daily Use of Mobile/Personal Technology

Given the omnipresence of personal technology, let’s enumerate the way it is used in our daily lives:

    • Waking up in the morning
    • Scheduling our days
    • Reminding users of time-based tasks
    • Capacity for constant communication
    • Problem-solving
    • Multitasking
    • Bio-metric monitoring
    • Others?

 

By definition, mobile technology is used when one is “on the move” and not tethered to a desk-based computer station. One can be driving in her or his car, one can be sitting in a bus or metro, one can be a lunch, one can be, one can be, one can be . . . In short, mobile technology has been completely integrated into virtually every single aspect of our waking life, which as noted, has become increasing mobile. So, what are the opportunities for eLearning in this context?

B. Opportunities for eLearning: mLearning

  1. Alternative Remote-Based Sites. Given the portability of laptops or even tablets, a learner can access a web-based portal to access information anywhere there is an Internet connection. In fact, a learner can almost always connect to the Internet using a Wi-Fi or Bluetooth connection from one’s smart phone. In this context, opportunities for sustained mLearning are created in areas other than the classroom or the home.  
  2. Transient Access. Think about accessing audio and/or textual content while driving a vehicle or in transit sitting in public transportation. These are the obvious opportunities and can be engaged in a sustained fashion, albeit often for shorter periods of time than when at a fixed-based learning site. What are some others?
    • When the learner is driving, a colleague or friend can serve as a veritable educational co-pilot, and even transforming transient access into an alternative remote-based site during longer trips
    •  mLearning can take place in transit when the content can be accessed using audio information. The value here is creating a backdrop of content that can engage the consciousness and cognitive functions through simple though repeated exposures
  3.  Anecdotal Access. How many times during the day do we simply look at our mobile technology for reasons other than that associated with eLearning? Many, many, and, for some, too many! In short, most individuals are tethered to their devices; in fact, a colleague named Kori told me her cell phone is her life. (Don’t judge; it’s a generational thing LOL! If fact, I joked that I “saved her life” when I once found her cell phone.) Regardless, an opportunity exists for mLearning each of the times we access our mobile technology.

C. Styles of mLearning

  1. Standard Web-Based Portal Access. This is the conventional style, which by its nature does not require discussion.
  2. Micro-Learning. We already have discussed micro-learning in the past. However, with the advent and increasing impact of mobile technology, the task for eLearning administrators will be developing content packages that are appropriate for different lengths of time, et cetera.
  3. Audio Content. Audio content currently exists in the form of recorded lectures and podcasts. However, as the technology advances, text-to-speech converters will become commonplace and will be utilized to access traditional text during transient moments.
  4. Flash Cards. An old friend of mine, David Margulious, was co-founder of the Quizlet start-up, which uses the “flash card” concept in eLearning. Flash cards are great ideas! In fact, I recently used old-fashioned paper flash cards when learning menu descriptions at a restaurant (long story LOL!). Anyway, using flash cards in a site-based setting is great, and opportunities for personalizing and sharing information sets are huge.

Imagine this though: using the flash card concept through an app that pops up whenever you access your mobile technology, think accessing your smart phone or smart watch. In order to check your e-mail or to read your text, the user is prompted to answer a single, quick flash card query. In this context, mLearning is completely integrated into the uses of a variety of mobile technologies.

Next time we’ll discuss a variety of eLearning issues. Stay safe and warm!

Craig Lee Keller, Ph.D., Learning Strategist

Useful Articles in Gamification (Part 3)

When looking for “seminal” articles in the field of gamification, one is confronted with works published in formal academic journals but more frequently from a variety of conferences. The field is fairly nascent and has been directed toward a wide variety of areas of focus. The best way to appreciate the field, perhaps, is to provide a sampling of a couple articles that provide an overview of the field. First, though, a quick discussion about the “father” of gamification . . .

NICK PELLING AND GAMIFICATION

Nick Pelling is credited for coining the concept of “gamification” in 2002 (though in a conference, he tells his audience it was in 2003). He divined the concept through his experiences in business school. Being told that success was based on defining what “you’re good at,” he quickly concluded that he was good at games given his years of work in the gaming industry. Business school, he stated, was centered on determining “present worth” of an asset. But upon reflecting upon games and business enterprises, Pelling had an epiphany: business schools were asking the wrong question. Economic value should be less associated with present worth and more associated with potential worth in the future.

The gaming industry was impacting all areas of culture, economy, and society in such a massive way that thoughtful entrepreneurs should be able monetize that insight. Pelling attempted to do that with an admittedly ill-fated startup called Conundra from 2003-06. Regardless of his failure, he identified two key elements in then-contemporary games: immersive interface design and digital content platforms; in the next wave, social media became an integral factor. Pelling is critical of the last element and envisions it as a crass forms of advertising and persuasion. His favored incarnations of the second stage focus on platforms that join people together and empower them. His examples of this include Kickstarter, AngelList, and even Match.com.

ARTICLES ON GAMIFICATION

A. “Does Gamification Work?—a literature review of empirical studies on gamification,” J Hamari, J Koivisto, H Sarsa, System Sciences HICSS, 2014.

Gamification, like any big idea, is great in theory. Articles such as Hamari’s are essential when investigating whether or not the theory actually works in practice. First, though, they demonstrate the almost exponential growth of literature in the field. Hamari and company look at a range of independent and dependent variables.

Hamari and company break down gamification into a simple linear progression:

Motivational AffordancePsychological OutcomesBehavioral Outcomes

Their literature review includes sites such as Google Scholar and ProQuest, which yielded large results; however, upon inspection, the literature that had been subjected to traditional peer-review was substantially lower. All withstanding, for those peer-reviewed articles with empirical studies and analysis, they did find positive associations, which were tempered due to factors associated with the study participants and other limitations. They pointed to other areas for possible research.

B. “How to Gamify? A Method for Designing Gamification,” Morshheuser B, Werder K, et al. System Sciences HICSS, 2017.

This article is interesting for a couple of reasons. First, it touches upon the major question of entrepreneurs seeking to apply game dynamics in existing or new fields. Second, and strangely, this concept of “designing gamification” runs contrary to Pelling’s original assessment. Gamification was not something that one applies to a given business sector, but what the games culture had been doing for years to all other industries. While Pelling was prescient, with passing years the operative issue became recognizing the mutual dynamics between the formal game industry and other industries. At this stage, of course, most of the influence flows from the game industry to other fields

Morshheuser’s article looks at the future of gamification given the prediction by the Connecticut-based Gartner Group. Gartner predicted in 2011 that by 2015 half of all organizations would be incorporating some type of gamification into their operations; however, others also have predicted that ventures into gamification are doomed to failure due to flawed concepts about game design.  In this context, Morshheuser and company sought to develop a methodology.

For the methodology, they developed a set of best practices, performed a literature review for gamification design, and then received feedback about their model from a battery of recognized experts. Their product was represented by an extremely detailed, if not tedious flow chart that focused on thirteen straight-forward requirements, such as: understanding goals and characteristics, engaging in an iterative design process, obtaining input from stakeholders, involve users, et al. Many of these requirements make eminent sense, for example, and most importantly, obtaining input from stakeholders and users.

Next week we’ll take a look at something completely new in the field of eLearning. Any ideas about areas you’d like us to pursue? Send us an e-mail!

Craig Lee Keller, Ph.D., Learning Strategist

Games vs. Gamification (Part 2)

It is January . . . time for looking at upcoming trends for 2017. An interesting way to look at gamification trends is to contrast them with game trends. Contrasting them helps to delineate commonalities and differences while identifying opportunities and limitations for applying gaming in the world of eLearning.

JAG Global Learning

JAG Global Learning

GAMING, CONSUMERISM, AND LIFE

Gaming is a major part of U.S. and international consumer culture. Regardless of the platform—Nintendo, PC, PlayStation, Xbox, and various mobile platforms—individuals play games while waiting for their dentist or the chicken to roast while at home. Advances in the field, and this is not surprising, are driven by technology.  Moreover, gaming has become an integral part of consumerism and rewards, driven by our use of portable technology, which has become a measure of identity. Life without it, for many, seems unimaginable. In short, gaming is a central to daily living not just education. But . . . let’s close the door of dystopia and focus on a couple of gaming trends to see their powerful application for eLearning.

Two key gaming trends are the use of GPS in the field and VR in a fixed environment.  Regarding the latter, VR technology has improved greatly and is becoming more widely available and affordable to the general public. In order to appreciate advances in eLearning gamification, let’s look at two important games: Pokémon Go and Resident Evil: Biohazard.

Pokémon is a wildly popular console game created two decades ago with the goal of players collecting, training, and using fictional characters (Pokémon) in battle. This concept was franchised through trading cards, movies, and videos. The most recent incarnation is Pokémon Go, which is a free mobile app that empowers participants to travel to different physical spots using GPS to locate different types of Pokémon. The Resident Evil console game is quite different. Instead of traveling to different spots in the “actual” world, through the use of cutting edge virtual reality (VR) headsets, the VR participant is immersed in a digital world, ostensibly supplanting the “actual” world. Biohazard has been singled out for its shocking, graphic realism.

NEW GAMING TRENDS AND GAMIFICATION

1. Variations of Reality

Variations of reality? Let’s look at references in popular culture: Keanu Reeves’ Neo in the Matrix and Jessie L. Martin’s Tom Collins in Rent. Neo combats the Matrix to release humans from their unconsciousness albeit physical slavery that sustains their virtual world; alternatively, Tom Collins, from MIT, is kicked out of his doctoral program for his theory of Actual Reality, which mocks theoretical concepts of reality in favor of civic action to address inequity and injustice.

Let’s look at different types of reality, as it were represented by the extremes noted above. When thinking about alternative uses and understandings of reality, remember the context. A primary gaming goal is to entertain the participant. There are, of course, secondary benefits, but entertainment is central. This can be performed through the satisfaction of game mastery or simply emotional release. The primary goal of gamification is different: learning, or for us, eLearning, which ultimately has the associated benefit of real-world application.

Virtual Reality (VR) provides gamers with a more compelling experience by supplanting actual or visual representations of the world with a complete simulation; likewise, VR provides learners with the most tangible sense of trial and error that they would otherwise only be able to obtain by personal training. What’s the obvious challenge for developers in eLearning? Gaming is a multi-billion dollar industry that has huge capital resources for R&D. eLearning does not have that benefit. However, in as much as the government uses VR in its training and executive operation, it is possible that educational institutions might be able to draw upon that intellectual capital given that government VR applications were created using public money.

Augmented Reality (AR) is capable of adding (augmenting) digital information to live videos. This provides users with an ability to appreciate space/size ratios among other things. Imagine using an AR app to position not-yet-bought furniture around a video of your living room. While this example draws on a consumer, marketing app, there are a range of eLearning opportunities. Note field use is not restricted to eLearning outside.

Program-Based Reality creates narrative scenarios through a basic user-computer interface. The “reality” is governed by the gamer or learner’s operation of commands, which then generates programmed results. This was a precursor of VR’s trial and error. This is traditional eLearning that uses in-class or Internet based educational portals.

On-the-Job-Training (OJT) is the traditional manner through which skills and trades are transmitted to new employees or apprentices. No use of technology per se. Each perspective of reality noted above—VR, AR, PBR, and OJT—figuratively and literally position the gamer or learner in his or her use of technology.

What are some of the new applications in eLearning? Nurse training, McDonalds management training, repair/maintenance, and anatomy tutorials are the most commonly sited examples. While we all may have our favorite “reality” approach to eLearning, but who is to say that they cannot be used in combination? Imagine training individuals working in complicated and vast storage and/or archival network. Much can be accomplished through each approach used above, with OJT being the final run through before employee independence.

2. The Future of Gaming and Gamification?

While Pokémon Go and Resident Evil are taking the gaming world by storm, there is another approach, just as important, but with a different modus operandi and significant future application for eLearning and gamification. Minecraft, one of the best selling video console games of all time, has been around for a relatively short time. While similar to other gaming applications, Minecraft is distinctive for incorporating the capacity for gamers to build virtual landscapes and even change the rules of the game; participants can play in various modes: survival, creative, adventure, and spectator. The game permits individual and multiple players.  Why should this be of value to eLearning and gamification?

As noted, gamification draws upon natural human capacities in a variety of ways, for example, competition and social recognition. Many elements of gaming, though, are based on competition. Yes, there is value here, but to reach its full potential, eLearning needs a wider focus. Minecraft permits survival (competition), but it facilitates adventure and creation too. Isn’t that what education and eLearning should be about?  Instead of creating platforms for competitive games, eLearning administrators can create intellectual and visual landscapes that depict the relationship of concepts and areas of study instead of relying upon analog outlines. Here, learners can walk through and access/add content information. On a different level, learners can create their own landscapes and projects or develop discussions questioning given ideas and offering new ones. The challenge here . . . as with the facets of gaming and its application in consumer culture, one must be mindful that the means of eLearning does not override the primary goal: learning.

Next week let’s take an academic turn in our discussion and look at some seminal gamification articles as well some recent publications. See you next week!

Craig Lee Keller, Ph.D., JAG Learning Strategist

Gamification and E-Learning (Part 1)

THE CONTEXT

When thinking of games in the context of learning, the conventional pedagogue might shutter. Games are for children! Students are learning so they might find their place in the adult world. If games were used in education at all, they were considered to be part of a “break” in learning, that is, students were given time to release excess energy and/or re-focus their thoughts for additional learning. Games were considered an external tool to facilitate learning, not a part of the learning process.

Yet gamification existed even in the traditional framework. How is that? Well let’s remember growing up . . . First, at one time during our early school days, we did a particular assignment well. Yea! We get a gold star. Second, during summer reading programs, readers would get a check next to every book read, and if enough books were read by summer’s end, he or she would get a prize. Third, in large college classes—before the era of privacy—professors would post exam grades, and students with excellent grades would be afforded social status. One can come up with other examples, but the above should serve to make the point.

Advances in technology have driven gamification, and home computing and the Internet have been the most important elements of this evolution. In addition, changes in educational philosophy, based on a large body of research, have pushed gamification into educational practice. So let’s look at the basics.

THE BASICS OF GAMIFICATION AND eLEARNING

A. Definition

While noting above that “gamification” existed in earlier eras, the term generally refers to the conscious decision to employ the concepts, motivations, and techniques of games into non-game venues. Such venues could be in employment productivity, marketing, but especially into education. In this context, gamification is not thought of as a respite from the “serious” work of education but an essential part of comprehension, retention, and application of knowledge. There have been a range of critiques on gamification, but it has generally been accepted and is increasing being employed as an important element if not the central element of most educational enterprises. (TABLE)

B. Gamification Elements

Games constitute systems that are governed the rules and tools of the game. Each system is based on a combination of chance, skill, and/or strategy with an overall goal ranging from simple completion to a competitive success. Games—and gamification—are so engaging due to various factors that can be broken down into rewards versus other elements. Regarding rewards, gamification designers will draw upon natural human tendencies toward achievement (intrinsic) or social status and/or tangible rewards (extrinsic). Related to rewards, albeit separate, are other natural human tendencies toward competition, human inquisitiveness, and socialization. Separate from notions of reward are others such as altruism, engaging narratives, and self-expression. Gamification in learning employs these elements to increase attention span and motivation toward the overall capacity for knowledge comprehension, retention, and application. (APPLE)

C. Participants

Gamification can be employed in three different contexts: solitary, competitive, and team building. Each one has it’s own value, though they can be employed separately or together depending upon the nature of the subject and organizational goals.

Lets come up with a simple educational goal: remembering an information set. This seems simple, but the challenge can come from the size of the set and whether or not set contents are ostensibly related. Gamification designers can develop tools assisting participants to do this as solitary individuals, competitively, or with a team. One can employ rewards for the individual or team or use an interesting narrative and/or mnemonics to enhance recall. (PENCIL)

Next week we will continue our discussion on gamification and will move into more subtle and cutting edge elements. I strongly encourage readers to send in memorable anecdotes about their educational experiences that relate to this subject. We will be sure to highlight them at the onset of the blog.

Oh, by the way, without looking, do you remember the three capitalized words at the end of each sub-section.  It was an attempt to draw you into a game that might pique your interest as one might in gamification. To facilitate learning such non-sequitors, one can visually situate the objects: imagine a table with a single apple and pencil on it, nothing else. Remembering that visual image is far easier than remembering three random words. See you next week!

Craig Lee Keller, Ph.D., JAG Learning Strategist

Gamification: A Holiday Wish

Tis the season . . . .what better way to accent the holiday season than to blog about games and toys? Well . . . at least gamification. Before getting into any deep, intense discussion about the subject, let’s begin with a few “stocking stuffers” to whet our collective appetite.

GAMIFICATION AND STOCKING STUFFERS

The inner child in me squeals: Yea!!!!! It’s time for the fun stuff. Various theorists and, yes, philosophers define games in different ways. They focus on concepts such as competition, entertainment, play, rewards, rules, and the like. Separately, while games are fun, they also meet other important needs, for example, education, understanding how to confront uncertainty, skill acquisition, and socialization.

Let’s touch upon some bite-sized thoughts to sample the world of gamification by looking at a holiday gift stocking. Instead of the incredibly big, overpriced-gift we all ask for (and may never receive), stocking stuffers frequently are items that can be broken down into a few different categories: fun food, toiletries, and the whimsical.

1. Fun Food

By fun food, think of candy canes, chocolate coins, and the like. They don’t sustain us, but whet our appetite and keep us interested. How does this relate to gamification?

Let’s remember the genesis of our blog on eLearning. This approach to education appreciates that learning is a human activity; the notion that students should sit in a formal classroom dutifully learning “dry” material is not only outdated but contrary research about how to better facilitate learning. The notion of “fun food” can be thought of in different ways. In the context of gamification, it can be thought of as a reward—a key element in games, which creates incentives. The point of the game is not candy, but to win, that is to learn. Gamification is a technique to keep the learner engaged and motivated. Why? Again, because we are humans who need incentives apart from the “dry” dictate to learn.

2. Toiletries

Ah, toiletries, not like fun food at all, LOL! Still we find stockings filled with floss, scented soaps, and toothpaste. Contrary to the notion of fun food, these stocking stuffers supply us with the necessities of our modern lives, things needed to take us through the New Year. Again, gamification?

Gamification seems to run contrary to the notion of necessities. We think of games, we think of rewards, but necessities are a part of many games (think game rule comprehension). Some game rules are simple while others are very complex. Understanding game rules grant a player strategic advantages while rule mastery grant her or him a sense of confidence. Gamification translates this dynamic into education. By understanding basic concepts, learners are better equipped to progress into more nuanced ideas that, obviously, build upon those concepts. Likewise, learners are affirmed in their progress with the appreciation their efforts have value.

3. The Whimsical

OK, we’re getting to the bottom of the stocking. What’s the whimsical? Think about fun, silly puzzles or the quirky item that we don’t need but we all want. This is similar to the notion of “fun food” but different . . .

Whimsy touches upon game elements relating to entertainment and play. Including whimsical elements peak our curiosity and arouse our desire to learn. This especially is valuable when dealing with subjects that otherwise might seem “boring” or “dry.” An interesting anecdote or an interesting factoid can offer the “hook” to draw one into the learning process. Gamification can accomplish this through the use of engaging narrative and animation that make one smile though not forget the purpose of the training.

Enjoy this holiday season and be safe and warm.

Craig Lee Keller, Ph.D., Learning Strategist

Tip 3: Pitfalls to Avoid in Self-Paced Learning

For the past couple of blogs, we have been reviewing different facets of the Flipped Classroom and Self-Paced Learning (SPL). You should have a greater degree of familiarity with these issues and are probably beginning to think about ways it can be incorporated into training programs. While the idea of SPL is simple, its implementation can be a challenge; there are many pitfalls to avoid, so it is useful to identify them at the onset.

SPL AND PITFALLS

Developing educational material and creating a structure for Flipped Classrooms and SPL is not the same thing as breaking traditional lectures into smaller pieces. A common pitfall is to replicate various elements of the traditional teaching didactic while embracing the Flipped Classroom and SPL in name only. Instead of being Student-Centric Learning, trainings often devolve into teacher-centric pedagogy.

1. Seductive Details

We all remember this trying experience: a thirty-page PowerPoint presentation chocked full with so much information that it is neither possible read nor understand. But, hey, that shouldn’t be so bad, should it, isn’t more better? Actually, no, more frequently is worse. Trainers frequently jam trainings with seductive details for any number of reasons: to illustrate their own “in-depth knowledge,” to demonstrate (to their supervisors) their level of preparation, to create content that meets the needs of learners at lower and higher levels, et cetera. Such trainings prompt some to leave early, others to “phase out,” and others to sit patiently to sign the attendance sheet. The handout eventually finds its place in a growing pile of dusty trainings.

Seductive details are hard to discount, since by nature they are interesting; yet, including them can detract from the educational goals of the training. Extraneous details take a variety of forms (graphics, illustrations, music, photographs, textual examples). Such information often amounts as “filler” and, sometimes, an experiential reward to “spice-up” the training. See! This training isn’t so boring!! But remember, the training is for learning not an exercise in toleration. Moreover, seductive details can detract from the transfer of learning, which empower learners to apply their knowledge in real-world settings.

2. Writing As Usual

Traditional forms of writing are linear in style. That is, most articles and books use a rhetorical style of presenting arguments logically supported by a variety of evidence. SPL, though, is different. The focus is student centered. The logic of argument is still important, but how can our students learn if, for whatever reason, our self-professed “logic” eludes them? Should we think, oh they’re not trying hard enough . . . or perhaps, they need to properly “self-pace” themselves. Such assessments can be seen as employing the traditional teaching didactic under the guise of a Flipped Classroom. What do you mean? Aren’t we breaking down the training into smaller pieces? Yes, but SPL is not simply an abbreviated outline: the whole is neither the sum nor greater of its pieces; the whole is simply different from its parts. So different facets of learning—behavioral, emotional, neuro-cognitive, and social among others—need to be considered when helping our students put together the pieces.

To truly employ the SPL approach, trainers should employ student-centered logic not simply the logic of their argument. For example, one should not assume everyone knows or understands key definitions used in the training, and research demonstrates students frequently are better served by addressing them at the onset. Similarly, research documents that foreshadowing key concepts in the beginning provides a context for content at later stages.

3. Over Excitement

In an earlier blog, we discussed the importance of the trainer’s character. He or she should not do anything to distract us from learning. Training should facilitate student learning not focus on exciting trainers. Hey, again, I thought the trainer should be exciting to draw me into the lesson . . . I don’t want to be bored! Yes, but before being exciting, they should be engaging, otherwise we risk replicating the traditional top-down teaching didactic.

While a teacher-centric approach should be avoided, we also must guard against over-excited presentations.  Whaaaaat?!   By over-excited presentations, I am neither referring to gamification nor role-based animation; both are central to SPL. Rather, “excited” presentations utilize software tools to highlight textual information. For example, textual examples sequentially spin into place with music, bullet points flash to create accent, and other graphic effects. Instead of facilitating learning, these tools are technology for the sake of technology creating cognitive overload degrading learner memory.  Blended learning, though, employs a variety of technologies and modalities to facilitate the learning, not demonstrate the trainer’s prowess with software. Consulting with training experts or even contracting for training can help training administrators strike a proper balance and focus for SPL.

Had this blog been a journal article, you might read seductive details and pages of citations. Yes—guilty as charged LOL! But wait . . . yes, please, cut him some slack . . . Writing is not synonymous to education. The former is only a tool in our educational holster, a tool used in different ways based on our framework. Flipping classrooms and SPL focus on student needs not intellectual vanity. So shhhh . . . don’t tell anyone I’m anticipating the 17th Edition of the Chicago Manual of Style!

Craig Lee Keller, Ph.D., Learning Strategist

Tip 2: Self Paced Learning and Remote Learning

Self Paced Learning and Remote Learning

Last week’s tip dealt with self-paced learning (SPL) and the issue of scheduling, in short placing the Flipped Classroom in the context of synchronicity. Remote Learning is another element of SPL. Scheduling deals with adapting learning to temporal realities of work life, whereas remote learning adapts the locale of the learning environment to SPL and synchronicity. At first blush, the comparison might seem peculiar—and, yes, there are areas of overlap—but appreciating remote learning is essential. Many blended approaches embrace learning that is inside and outside of the classroom; indeed, it behooves the educator to take this approach with certain subjects (think CPR). But there are some approaches that are wholly remote and generate large economies of scale. How might smaller learning and training venues create such economies?

SYNCHRONICITY

Let us remember the traditional teaching didactic: in-class group instruction led by the teacher with homework performed outside the classroom. The first element is considered real time (synchronous) whereas the second is not real time and remote (crudely synchronous). Here, SPL cannot function due to a standardized time schedule, that is, education is not self-centered around the learner and thereby not asynchronous. With the Flipped Classroom, educators can “flip” the traditional approach and facilitate SPL by using various learning modalities and technologies.

Some Flipped Classrooms function entirely outside of the classroom: imagine on-line degree programs where learners start and end independently of others. Such programs generate economies of scale and operate in a larger educational setting.

While being wholly remote, such programs can combine synchronous and asynchronous learning. Independent of others, learners can access recorded lectures, shared reading materials, and message boards for popular questions. This is blended with synchronous elements such as chat groups, live teacher response to questions and webinars. But, how can live chat groups and gamification operate? With larger numbers of individuals enrolled in a given program, regardless of the time a learner starts and progresses, there will always be learners at various stages of the training: first stage: introduction; second stage: basic concepts, et cetera. How is it possible for smaller venues to gain such economies of scale?

A. Best Practices

Many organizations in public sector have common trainings across disciplines. For example, all federal government employees are required to receive yearly trainings on matters of conflict of interest. Generally, each department and/or agency has its own training program (with some standardized information). Imagine if this could be streamlined. In this context, instead of waiting to sign-up for training in the January of the next year, new employees could simply sign-in through a central training portal using their government e-mail. Since various parts of the government are always hiring, the new employee can start the training within a prescribed period of time and then pursue a SPL approach. Learners who progress at a slower or faster pace need not worry, because the universe of new employees will be large enough to ensure that each new stage of the training is populated with enough learners to permit both asynchronous and synchronous learning.

In the private sector, one can imagine similar trainings, though not necessarily across disciplines. Imagine centralized trainings for work-site safety for new construction employees. Such a program could not only operate independent of the hire date but also across different corporate entities.

B. Membership Organizations

Membership organizations offer an important venue for centralized, remote SPL. Trainings would be unique to the character and mission of that membership organization and could be utilized on the level of state and/or local chapters. Think about ethics trainings for the real estate industry or, importantly, courses for “training the trainer.” Similar remote trainings could exist as subject-based tutorials in a variety of areas; synchronous elements could be complimented with live, on-line practicum of those going though the “training for trainer” program. Perhaps the most obvious training for membership organization would be matters relating to membership oaths, responsibilities, et cetera.

C. Nationally-Recognized Certifications

Nationally-Recognized Certifications are similar to best practices but with an important exception, the criteria for knowledge mastery and application is defined by a central organization that issues certifications. Here, wholly remote training could be initiated in substance abuse counseling. Again, there would be opportunities for both asynchronous and synchronous learning. All withstanding, all such trainings much be structured and geared toward being inclusive of differences within states and localities.

Another interesting avenue for wholly remote training is in the field of industry and/or machine operation. These trainings would be operated from the proprietary portal of a business. Here, for a given technology, say, a new magnetic resonance imaging machine, or, computer software, the portal would be available to the new user for basic and skilled use of the different facets of the buyer’s new purchase.

Self-Paced Learning is a basic concept, not a formula. Different approaches serve different needs and learning goals. Contact JAG Global Learning Group to find out how we can help your company or organization.

Craig Lee Keller, Ph.D., JAG Learning Strategist

Tip 1: Self Paced Learning and Schedules

One of the hallmarks of the Flipped Classroom is self-paced learning. Yes, we discussed that a bit before, so tell me more . . . Self-paced learning empowers learners to spend more time on certain concepts and information sets before moving onto the next stage. This approach draws upon micro-learning logic as well as the insight that differing individuals have differing learning strengths and weakness. The digital architecture of flipped classroom teaching modules accommodates this by guiding learners back and forth through various paths in the training to facilitate comprehension and retention. Traditional learning models do not address this differential; rather, they are linear in their flow and focus while operating under non-negotiable time constraints. Imagine, this month in a traditional classroom: learners focus on topic ABC and meet twice a week for fifty minutes; next month, learners focus on topic XYZ, and so on. Even though trainings rarely last that long, a similar logic obtains. Yet there is another time-related factor to consider when structuring training: learning schedules.

Learning and Schedules

Two types of time constraints are associated with learning. First, even though an organization has already accepted the concept of the flipped classroom, it may need to document training completion by a set time. Second, in order to participate in the training, participants must be able to integrate training time demands into their respective schedules. Sometimes this latter matter is not significant, but other times it can be quite restrictive.

  1. One-Step-At-A-Time. 
    • In order to appreciate the context of schedules, let us place it in the framework of micro-learning. There are two simple categories, both of which are mutually reinforcing, central concepts and information sets. The training need not be bifurcated in this fashion, but it can serve as a useful rubric when appreciating learner progress. Similarly, it can highlight the strengths and weaknesses regarding differing learning styles.
  2. Individual Learning Pace & Plans. 
    1. Fast-Medium-Slow: Because of different job demands and schedules, training administrators would do well to have separate “tracks” for the pace of their different learners. Think of different training options: full-time intensive versus part-time and slowly paced. In this context, the flipped classroom is great for accommodating both time constraints through self-paced learning. For learners who require more time or with overly restrictive work requirements, they will be offered the latitude to complete the training over a longer period of time, say one month. But for those who are fast-to-moderate learners, then a shorter schedule may be set. Let us all remember not to associate negative value judgments toward “slow” learners; again, we all have our strengths and weaknesses. A former colleague is extremely intelligent and articulate, but was unable to write a required training. Why? My former colleague has dyslexia and compensated for it by developing his oral acumen to an extremely high level.
  3. Tracking Different Tracks
    1. Simply because different learners benefit from different paces of training due to their learning styles or job requirements does not mean that training administrators should remain oblivious to learning progress. Indeed, in order to best facilitate learning progress, administrators need to be keenly aware.  But how can you do this without being overbearing? Again, super question. To facilitate self-paced learning and to avoid the negativity associated with traditional grading and teacher oversight, it is useful to provide the learner with visual measures of training mastery. While progressing through a given module or training section, the learner will be able to clearly see (on the side/top) measures of progress for core concepts and information sets. If he or she still needs work in a given area, then such would be highlighted as well. Creating this type of an overview empowers the learner for her or his accomplishment and helps them comprehend how the different parts of the training are connected. Through this process, of course, the administrator is cognizant of learner progress and is able to engage in a virtual dialogue. Again, this permits learners to progress at their own pace while having the nurturing support of a mentor—outside of the glare of any possible judgment of fellow learners. As a result, these learners will feel more comfortable and have a greater incentive to participate during in in-class team-building exercises.

Think about these ideas. When you do, then you will begin to better analyze the different elements of your organization’s training culture and see opportunities for growth. See you next week! And, as always, please write in to let us know what you’re thinking!

Craig Lee Keller, Ph.D., Learning Strategist