Category Archives: Training

Now is the Time to Do Less of More

This week we struck up a conversation about the general state of eLearning design in the corporate world. We ruminate over our belief that companies should consider doing less of more:

Bwc BRANDON: So I thought this week we would discuss the overwhelming number of requests for “training” that come from business units and stakeholders. It seems like some people think “training solves all the problems.”

I’ve been on the inside and the outside of several corporate learning organizations over the years, and one trend that I’ve seen explode recently is a “factory mentality” designed to “templatize” training. I’ve seen these factories operate almost ’round the clock packaging “rapid eLearning” courses with little regard for formative or summative analysis, or interaction that motivates a learner to participate. It’s really a “page turner” world out there in many instances. Some of this is pure economics — many learning organizations are funded by business units. If a business unit allocates a specific amount of dollars for “training” they expect those dollars to actually be spent, regardless of the necessity or quality of the training.

Why have training if it’s not good? I’ve counseled the organizations I work for/with to do “less of more”. I firmly believe if most training organizations just stopped producing about 40% of what they are doing today — just stopped cold turkey — no one would even notice.

Drj DOLLY: I think one reason that training can seem so irrelevant is because it is so divorced from the day to day activities that the jobs actually require. So, these people who are in sales for instance, talking and corresponding with clients everyday, come to training and spend 4 days listening to someone speak at them. These week-long explorations of Powerpoint slides don’t engage the learner. They just become data dump sessions.

Bwc Yeah, I agree. I personally think sales training should be high-touch, situational, and as contextual as possible. It seems to me that there are two avenues to drive down when producing sales training: basic “transfer of information” about products, services, etc., and scenario-based/role-play simulations that place the participant in authentic situations. At Sun, we leveraged the community for the transfer of information component by providing a user-generated content platform. Sales people ate it up. They could get small chunks of product information or sales techniques from experts in the field and download it to their mobile device. We then had “Sales University” for the mandatory accredited training courses.

Drj And the thing is, if people are just going to be sitting in darkened rooms, why bother going to the expense of shipping them across the country? If it’s just memorization of information, there’s plenty of fairly easy and cheap ways to get that across in an online setting. However, both face to face and online activities can be so much more engaging and rich.

Bwc Agreed. One thing that seems to be missing is an evaluation of actual sales skills done in a formal manner. If we’re training these folks to sell, then we need to really look at each individual and evaluate their readiness to sell. It’s one thing to lecture them, have them role-play, provide feedback, and then send them on their way. Where do we assess their readiness to do their job? Is that for their manager to determine outside of the training? If so, is training’s role just to “provide the foundation”?

Drj And  evaluation doesn’t have to be a test. It can be a demonstration, a portfolio or series of smaller activities built into the curriculum.

 

Bwc Yes, one vendor I worked with provided role-playing scenarios in an online format using computer webcams and FlipCams. Participants would video themselves doing their pitch, and then upload it for the cohort and the facilitator to critique.

Drj In my eyes, that’s a perfectly valid evaluation, as long as the learning objectives were to improve their sales pitch, not to learn the capitals of African countries. The whole point is to have evaluation that supports your objectives and curriculum. Excellent evaluation can be painless and seamless.

This post can also be found at The Total Learner Experience

Creative Effective Training Evaluation

Drj Dolly: Brandon ranted about ineffective evaluations while I was holed up under the 2 feet of snow here. The snow is still here, but my Internet is finally back. His comments about evaluation made me wonder what I consider effective evaluation to look like. Cumulative evaluation should be as authentic as possible. If you want someone to be an effective salesperson, you’d better identify what competencies are required and then have them replicate and practice as best they can in the classroom environment.

Bwc Brandon: Good point. I concur. However, more and more organizations are hit with the high-cost of travel and the inefficiency of removing people away from their jobs for instructor-led training. We need to provide effective strategies for authentic evaluation in an online format.

Drj So I can think of two ways to recreate these situations in the digital world: virtual simulation and/or role-playing. Learners will have different profiles. Does someone who is technically minded need the same practice as someone who is naturally a people person? Both these individuals need to come out with the same skill sets at the end, but perhaps they need different practice. Formative self assessments combined with flexible course sequencing can allow individuals to focus on their areas of real need.

Bwc That just describes a sales training course I completed using Thiagi’s 4-Door Model. It allowed the learner to “self-adjust” the content based on their own self-leveling of knowledge. It does beg the question though: how do you “branch” an evaluation based on different learner profiles? Can you have an effective evaluation instrument via a dynamic system that presents a contextual series of assessment items based on the learner’s individual profiles?

Drj I think that you can have a self-assessment that gives the learner guidance in their own strengths and weaknesses.

Bwc OK, so you’re talking about self-assessment. What about an actual skills certification? One that can affect a learner’s job status, salary, or in the case of compliance or regulatory situations, a learner’s knowledge that could have life or death consequences? Can a dynamic evaluation instrument provide the appropriate assessment of knowledge?

Drj I don’t know what you mean by “dynamic evaluation instrument”.

 

Bwc “Dynamic pooling” is when the system displays content based on a learner’s input at the time of input.

Drj What you are talking about now is less about the assessment/evaluation used and more the consequences related to that assessment or evaluation. The SATs are pretty weighty and they’ve been using a dynamic response for years. A student gets progressively harder questions until incorrect responses are entered. Then a cycle commences where easier and harder questions are given to the student until the logarithm determines what the student’s level of mastery is. I’d say that stakes are high, but the College Board feels comfortable using this dynamic response.

Bwc Right. So I’m saying we need a similar system in corporate learning where appropriate assessment techniques seem to be a missing factor. In eLearning, there is a cycle of ineffective self-check systems instead of situational problem-based assessments. For example, a colleague was discussing with me the usage of “misconception” problems in assessment. They can present more authentic situations such as posing the problem in a scenario and requiring the learner to identify the parts of the scenario that are wrong or inaccurate. Even using open-ended question types where the system evaluates based on a keyword or series of keywords can be quite effective. How are we truly able to measure whether knowledge or skills are transferred if we’re not willing to properly evaluate?

Drj I like that because some people are just natural or trained to be good test takers. That kind of exercise actually accurately tests knowledge that they have, rather than their ability to suss out a poorly written stem or item. I know you are all about performance. Shouldn’t people’s training be based upon actual deficits in their performance and knowledge? And if they are high performers or can demonstrate mastery of course materials, shouldn’t they be rewarded by being allowed to choose their own training regimen, anyhow?

 

This post first appeared in January 2010 at The Total Learner Experience