Premium Essay

Training Evaluation Methods

In: Business and Management

Submitted By nazzrinnazz
Words 5483
Pages 22
An Excerpt From

Evaluating Training Programs by Donald L. Kirkpatrick and James D. Kirkpatrick
Published by Berrett-Koehler Publishers

Contents

Foreword

ix

Foreword to the Third Edition

xi

Preface

xv

Part One: Concepts, Principles, Guidelines, and Techniques
1. Evaluating: Part of a Ten-Step Process

1
3

2. Reasons for Evaluating

16

3. The Four Levels:An Overview

21

4. Evaluating Reaction

27

5. Evaluating Learning

42

6. Evaluating Behavior

52

7. Evaluating Results

63

8. Implementing the Four Levels

71

9. Managing Change

75

10. Using Balanced Scorecards to Transfer Learning to Behavior

82

11. So How Is E-Learning Different?

95

v

vi

Contents

Part Two: Case Studies of Implementation

115

12. Developing an Effective Level 1 Reaction Form:
Duke Energy Corporation

117

13. Evaluating a Training Program for Nonexempt
Employees: First Union National Bank

124

14. Evaluating a Training Program on Developing
Supervisory Skills: Management Institute,
University of Wisconsin

131

15. Evaluating a Leadership Training Program:
Gap Inc.

144

16. Evaluating a Leadership Development Program:
U.S. Geological Survey

168

17. Evaluating a Leadership Development Program:
Caterpillar, Inc.

186

18. Evaluating Desktop Application Courses:
Pollak Learning Alliance (Australia)

200

19. Evaluating an Orientation Program for New
Managers: Canada Revenue Agency, Pacific
Region

206

20. Evaluating Training for an Outage Management
System: PacifiCorp

221

21. Evaluating a Coaching and Counseling Course:
Grupo Iberdrola (Spain)

239

22. Evaluating a Performance Learning Model:
Defense Acquisition University

262

23. Evaluating an Information Technology Skills
Training Program:The Regence Group

276

24. Evaluating

Similar Documents

Free Essay

International Human Resource Management

...Report Training Evaluation Submitted by Miss Nathaporn Janped 55760213 MissThunchanok Neamsawan 55760541 MissSirada Janthon 55760718 Present Mr. Lorenzo E.Garin Jr Training and Development Naresuan University International College Content Titles Pages Content 2 Introduction 4 Reasons for evaluating training 5 - Formative Evaluation 6 - Summative Evaluation 6 Overview of the Evaluation Process 8 Outcomes Used in the Evaluation of Training Program 9 -Reaction Outcomes 9 -Learning or Cognitive Outcomes 9 -Behavior and Skill-Based Outcomes 9 -Affective Outcomes 10 -Results 10 -Return on Investment 10 Determining Whether Outcomes are Appropriate 11 -Relevance 11 -Reliability 13 -Discrimination 13 -Practicality 14 Evaluation Practices 15 - Which Training Outcomes Should be Collected 16 - Evaluation Designs 18 - Threats to Validity 18 - Types of Evaluation designs 21 Consideration in choosing an Evaluation design 24 Determining return on investment 25 - Determining Costs 25 - Determining Benefits 26 Other Methods for Cost-benefit Analysis 27 Practical Considerations in Determining ROI ...

Words: 3530 - Pages: 15

Premium Essay

Review Framework for Capacity Building Program

...Impact assessment of capacity building and training: assessment framework and two case studies Jenny Gordon and Kevin Chadwick Centre for International Economics, Canberra February 2007 The Australian Centre for International Agricultural Research (ACIAR) operates as part of Australia’s international development cooperation program, with a mission to achieve more-productive and sustainable agricultural systems, for the benefit of developing countries and Australia. It commissions collaborative research between Australian and developing-country researchers in areas where Australia has special research competence. It also administers Australia’s contribution to the International Agricultural Research Centres. ACIAR seeks to ensure that the outputs of its funded research are adopted by farmers, policy makers, quarantine officers and other beneficiaries. In order to monitor the effects of its projects, ACIAR commissions independent assessments of selected projects. This series reports the results of these independent studies. Communications regarding any aspects of this series should be directed to: The Research Program Manager Policy Linkages and Impact Assessment Program ACIAR GPO Box 1571 Canberra ACT 2601 Australia tel +612 62170500 email © Australian Centre for International Agricultural Research GPO Box 1571, Canberra ACT 2601 Gordon, J. and Chadwick, K. Impact assessment of capacity building and training: assessment framework and two case studies. Impact Assessment...

Words: 54506 - Pages: 219

Premium Essay

Journal

... PERSPECTIVE ON PRACTICE Evaluation of training in organisations: a proposal for an integrated model Pilar Pineda ´ Universidad Autonoma de Barcelona, Barcelona, Spain Abstract Purpose – Training is a key strategy for human resources development and in achieving organisational objectives. Organisations and public authorities invest large amounts of resources in training, but rarely have the data to show the results of that investment. Only a few organisations evaluate training in depth due to the difficulty involved and the lack of valid instruments and viable models. The purpose of this paper is to present an evaluation model that has been successfully applied in the Spanish context that integrates all training dimensions and effects, to act as a global tool for organisations. The model analyses satisfaction, learning, pedagogical aspects, transfer, impact and profitability of training, and is therefore a global model. Design/methodology/approach – The paper’s approach is theoretical, and the methodology used involves a review of previous evaluation models and their improvement by comparing their application in practice. Findings – An analysis of pedagogical aspects enables training professionals to improve training quality, as they are able to identify any weaknesses in elements, such as training design, needs analysis and training implementation, and improve on them. In fact, the quality of these elements depends entirely on the training professional. The improvement...

Words: 8451 - Pages: 34

Premium Essay

Wwjk

...CHAPTER DEVELOPING AN EVALUATION PLAN 4 As program staff start planning for program development and begin addressing the components of the logic model, they should keep in mind that as the logic model takes shape, the development of evaluation plans will follow soon after. The logic model can act as a guide to assist you in determining when your evaluation plan should be developed. As you identify the accomplishments and outcomes in your logic model, the next question to ask yourself is, “How will I determine if I met my accomplishments and reached the outcomes I identified?” The evaluation plan will provide a framework for why the evaluation is to be conducted, what is to be evaluated, and how the evaluation will be conducted. After you have assessed the community needs and determined what services/activities will be implemented to address those needs, the evaluation plan is the next step in your planning process. Empowerment Evaluation Before learning how to develop an evaluation plan, it is important to look at the purpose of conducting a program evaluation and understand the type of evaluation models available. This section of the chapter introduces the empowerment evaluation model and the benefits of using this model for program development and improvement. Gutierrez (1994) defines empowerment as the “process of increasing personal, interpersonal, or political power so that individuals, families, and communities can take action to improve their situations” (p. 202)...

Words: 6724 - Pages: 27

Free Essay

Human Servics

...we hope that they will pay it forward. Program planning and program evaluation are both the process and the product of the political and economic environments. Program planning is when you plan something out and make sure that the processes are being followed to ensure that the plan makes it to the final result. With this you are going to need to gather information by either doing surveys or by using information that you have gathered throughout you life span. Proper planning is done by following a step-by-step approach to building a reliable proposal. Planning also shows how the risks we take will assess the service delivery. Each step in the planning process will have its own component in the body of the proposal. Program evaluation is Program evaluation is the application of different social research designs in assessing the needs and results of programs. Evaluative research utilizes various research designs including exploratory, descriptive, and experimental designs (Yuen/Terao, 2003). The program evaluation provides both the formative and summative data that could be used to measure and assess the desirability and quality of the plan and its program (Yuen/Terao, 2003). With the evaluation it’s going to run parallel to the program planning. If the planning doesn’t work then how are we going to do an evaluation on it? The evaluation will coincide with the planning. It will also assess the needs of the program...

Words: 607 - Pages: 3

Premium Essay

Case Study

...exception. Learning from the case study there is indeed challenges that the phenemin company is going through due to the fact of inadequate staffing, lack of training for qualified CSR. And the problem of carefully evealuating the performance of CSR in the phenomin company.In order for the Phenomine company to succeed it engaged the services of qualified HR specialist who came out with the two methods of assessing and evaluating CSR performance.The two methods are results of clerical test and results of clerical samples. 1. How do you interpret the reliability of results for the clerical test and work sample? Are they favorable enough for phonemin to consider using them for keeps in selecting job applicants? My answer to this question is that looking at the various components of the evaluating process of the test results, it seems that the results of the clerical test results seem to make some sense .I understand that sometimes people term to get nervous at the begging of a test but once they get used to it and get settle that nervousness is reduced and the person is able to do well. Therefore I m not surprise to see time 2 been higher than that of time 1.I think the results for clerical test is viable for phenomin to maintain in screening and selecting Applicants.I will also suggest they maintain this kid of evaluation within the department or organization for years which will give a lot of experience to the CSR so that major mistakes will be minimized. 2 . How...

Words: 573 - Pages: 3

Premium Essay

Faculty Profile Updater System

...Chapter 1 THE PROBLEM AND ITS SCOPE INTRODUCTION Rationale of the Study Managing the paperwork is one of the toughest things a new human resource manager has to learn the first couple of years in the human resource department. Memos, directives, faculty and staff development forms, administration staff and personnel forms, work requests, and general FYI (For Your Information) papers can really accumulate if they are not organized and handled with efficiency. This does not even take into account the additional faculty work that must be graded, evaluated, recorded, and passed back to the faculty. According to some surveys, during the course of just one school year, the average HR manager will have to handle more than ten thousand faculty papers. The educational reforms of the past twenty years have been blamed for placing an intolerable burden on HR managers and it is no wonder that this is cited as one of the main reasons for quitting. Record keeping and administration is often time-consuming and repetitive and many see it as detracting from the HR manager’s real purpose to manage. The fact remains however, that like other professionals, HR managers have to document progress, write plans, and keep accurate records, as well as keep up to date with educational policy not only in a single department but all throughout the school campus. There are informational requirements at various levels. The personnel from the administrative...

Words: 4620 - Pages: 19

Free Essay

Evaluation

...April 3, 2016 C H A P T E R 3 Evaluation Methods Learning Objectives 1. Recognize differences between evaluation methods and how they support the human factors design cycle 2. Design formative and summative human factors studies 3. Understand representative sampling and the implications for study design and generalization 4. Design an experiment considering variables that are measured, manipulated, controlled, and cannot be controlled 5. Interpret results and recognize the limitations of a study 6. Identify the ethical issues associated with collecting data with human subjects 1 April 3, 2016 PURPOSE OF EVALUATION 3 TIMING AND TYPES OF EVALUATION 5 LITERATURE REVIEW, HEURISTIC EVALUATION, AND COGNITIVE WALKTHROUGHS USABILITY TESTING COMPREHENSIVE EVALUATION AND CONTROLLED EXPERIMENTS IN-SERVICE EVALUATION 5 7 8 9 STEPS IN CONDUCTING A STUDY 10 STUDY DESIGN 11 ONE FACTOR WITH TWO LEVELS ONE FACTOR WITH MORE THAN TWO LEVELS MULTIPLE FACTORS BETWEEN-SUBJECTS DESIGN WITHIN-SUBJECT DESIGNS MIXED DESIGNS SAMPLING PEOPLE, TASKS, AND SITUATIONS 13 13 13 14 14 14 15 MEASUREMENT 15 DATA ANALYSIS 16 ANALYSIS OF CONTROLLED EXPERIMENTS ANALYSIS OF DESCRIPTIVE STUDIES 16 17 DRAWING CONCLUSIONS AND COMMUNICATING RESULTS 18 STATISTICAL SIGNIFICANCE AND TYPE I AND TYPE II ERRORS STATISTICAL AND PRACTICAL SIGNIFICANCE GENERALIZING AND PREDICTING ...

Words: 11755 - Pages: 48

Premium Essay

Marketing

...Module Study Guide Information and Communication Technology The Claude Littner Business School The Claude Littner Business School Information and Communication Technology Module Study Guide |Module Code |BA40019E | |Level |4 | |Credits |20 | AY2014-2015 Version No 1 © UWL 2014 Location/Paragon Information and Communication Technology Module Study Guide |Contents |Page No. | |Module Leader and Teaching Team Details…………………… 4 | | | | | |Facts and figures | | | | | |Section A Overview and Content | | |1 Welcome and Introduction to the Module………6 ...

Words: 4674 - Pages: 19

Premium Essay

Evaluating the Consultation and Education Department Research Paper

...their consultation and education department. This paper will describe at least one process evaluation measure and at least one outcome evaluation measure that could be suggested for the Consultation and Education Department at Greenby Community Mental Health Center to display the program effectiveness and efficiency. The paper will also explain the scope and purpose of the chosen process evaluation and outcome evaluation measures and how they influence the design. Issues and challenges that may arise from evaluating the Greenby Community Mental Health Center will be covered. Finally, why an evaluation may be helpful to the Consultation and Education Department director’s situation will be explained. “Program evaluation is carefully collecting information about a program or some aspect of a program in order to make necessary decisions about the program. Program evaluation can include any or a variety of at least 35 different types of evaluation, such as for needs assessments, accreditation, cost/benefit analysis, effectiveness, efficiency, formative, summative, goal-based, process, outcomes, etc. The type of evaluation one undertakes to improve ones programs depends on what one wants to learn about the program. (McNamara, n.d.)” For the unique situation faced by the Consultation and Education Department at Greenby Community Mental Health Center, the cost/benefit analysis evaluation measure could be suggested.” A cost benefit analysis finds, quantifies, and adds all the positive...

Words: 1312 - Pages: 6

Premium Essay

Assignment: Error Analysis

...Input, Process and Products (CIPP) In Learning Programs Assessment. AZIZI HJ. YAHAYA Ph.D Jabatan Pendidikan Asas Fakulti Pendidikan Universiti Teknologi Malaysia Skudai, Johor. ABSTACT: Assessment is one process to determine problem, choose relevant information, and collect and analyze information to report useful summary to decision maker. Evaluation model discussed in this topic was CIPP Stufflebeam’s model. CIPP assessment's model selected because his effectiveness to get revenue formative and summative and to find decision and problem-solving ability. CIPP assessment's model may be made assessment whether before, during or after the project conducted. This very different with Stake's approach assume that researcher may make level current study implementation or during the programme running. CIPP assessment's model also be formed to satisfy programme mastermind and administration not just filling individual ' wish. Lastly CIPP is not designed to prove a decision but act as to improve where information derivative later can be made as a guide to planning something programme. Introduction Assessment is one continuous process to determine method proposed applies in lesson by teachers and at the same time supervisor can give guidance and guide to them to overcome the shortage that exists. The assessment questionnaire and interview also should be used so that the feedback is total and real. This feedback result might be noted when conducting other courses at future time. A few assessment...

Words: 5261 - Pages: 22

Free Essay

Factors Affecting Bsmt Students Study Habit

...1 WHAT IS A FIELD STUDY? The field study is an integral part of the HDSR Program, and is the basis for much of the upper level course work required by our majors. The field study allows students to: • gain experience in integrating the theoretical perspectives learned in the classroom with experiences gained in the field; • achieve insight into the workings of an organization; • become more conscious of the relationship of social roles, institutional dynamics, and larger cultural systems. When students return to campus, Field Study Seminar assists students in analyzing and interpreting their experiences, culminating in a major academic paper. An HDSR field study differs from a conventional internship or practicum in important ways. The main difference lies in the purpose. The primary purpose of a conventional internship or practicum is for the student to perform a job and learn skills that will be useful in a future career. In contrast, the HDSR Field Study is an ethnographic research project. Its main purpose is for the student to hone his or her analytical skills and gain insight into the dynamics of the organization in larger societal context. That is not to say that the job, in and of itself, is not important. HDSR students are expected to work diligently, and make every effort to contribute to the organization in positive ways, along with the added dimension of observing and analyzing the organization. An HDSR field study might be thought of as a conventional internship/practicum...

Words: 4686 - Pages: 19

Premium Essay

How to Prepare for Interview

...• • Chewing gum Not knowing enough about the organization Arriving late Misrepresenting yourself or stretching the truth Making negative remarks about a previous manager or co-worker Rambling on and on…what was the question again? Making inappropriate remarks Types of interviews The screening interview • • • • • Usually occurs with someone from Human Resources Can be over the phone or in person HR will try to verify the information on the résumé and find out if you meet the minimum requirements for the position Take this interview as seriously as an in-person interview If you pass this phase, you will be asked to meet with a Hiring Manager (or panel) for a selection (face-to-face) interview At TELUS, we use the behavioural method of interviewing. The premise of behavioural interviews is that past behaviour is the best predictor of future behaviour. The selection interview (behavioural interview) • • • The interviewer will mention a specific situation and ask you to explain how you dealt with it; Questions often...

Words: 633 - Pages: 3

Premium Essay

Rsearch Evaluation

...TOPIC: Evaluation Research Content Page Introduction : 1 The social and political context evaluation research: the utilisation of evaluation results : 2 Negotiating the evaluation : 3 Process of evaluation research : 3 Conceptualisation and Diagnosis : 3 Appraisals, Needs, and Impact Assessments : 4 Formative evaluation : 4 Programme monitoring and process evaluation : 5 Effectiveness and efficiency Assessment : 5 Evaluation design : 6 Purposes of evaluation research : 6 How will evaluation research be used : 6 Guidelines for maximising the utilisation of evaluation research results : 7 Conclusion : 8 Bibliography : 9 Introduction Evaluation research, sometimes called programme or project evaluation refers to a type of research rather than a specific research method (Babbie, 2001). It concerns itself with determining whether a social intervention, policy, or programme has produced or not produced the intended result (Cloete, 2006). Rossi, Freeman, and Lipsey (2004) define programme evaluation as the use of social research procedures to systematically investigate the effectiveness of social intervention programmes. Patton (1986) has defined programme evaluation as the systematic collection of information about the activities, characteristics, and outcomes of programmes for the use by specific people to reduce uncertainities, improve...

Words: 2858 - Pages: 12

Free Essay

Business

...or through his agents. There are different methods of collecting primary data. Each method has its relative merits and demerits. The investigator has to choose a particular method to collect the information. The choice to a large extent depends on the preliminaries to data collection some of the commonly used methods are discussed below. 1. Direct Personal observation: This is a very general method of collecting primary data. Here the investigator directly contacts the informants, solicits their cooperation and enumerates the data. The information are collected by direct personal interviews. The novelty of this method is its simplicity. It is neither difficult for the enumerator nor the informants. Because both are present at the spot of data collection. This method provides most accurate information as the investigator collects them personally. But as the investigator alone is involved in the process, his personal bias may influence the accuracy of the data. So it is necessary that the investigator should be honest, unbiased and experienced. In such cases the data collected may be fairly accurate. However, the method is quite costly and time-consuming. So the method should be used when the scope of enquiry is small. 2. Indirect Oral Interviews : This is an indirect method of collecting primary data. Here information are not collected directly from the source but by interviewing persons closely related with the problem. This method is applied to apprehend culprits in case...

Words: 1115 - Pages: 5