Evaluate Training: Building an Evaluation Plan

What to know

  • Evaluating your training can help you improve your current and future trainings.
  • You should make your evaluation plan early in the training development process.
  • Making an evaluation plan includes determining the evaluation’s purpose, developing questions, and choosing data evaluation methods.

Overview

Training evaluation is the systematic process of collecting information and using that information to improve your training. Evaluation provides feedback to help you identify if your training achieved your intended outcomes, and helps you make decisions about future trainings.

How to make an evaluation plan

You should think about your evaluation plan early in the training design process. Work with training developers and other stakeholders to identify the:

  • Evaluation purpose
  • Evaluation questions
  • Data collection methods

Your training stakeholders might include the intended audience, organizational leaders, or others with an interest in the training.

1. Determine the evaluation purpose

An evaluation purpose explains why you are conducting an evaluation. To help shape your evaluation purpose, consider who will use the findings, how they will use them, and what they need to know. You might use training evaluation findings to:

  • Develop a new training
  • Improve an existing training
  • Provide instructor feedback
  • Determine if your training met the desired outcomes
  • Make decisions about resource allocation

Evalutation purpose examples‎

1. You have an online training and find that many learners start but do not complete the training. You want to do an evaluation to determine how to improve completion rates.


2. Your program invests heavily in classroom training. You need to know if the trainings are effective to justify the resources your program is using.

2. Develop the evaluation questions

Create evaluation questions that match your purpose. Evaluation questions are broad, overarching questions that support your evaluation purpose—they are not specific test or survey questions for learners to answer.

Evaluation questions are often focused on one of two categories: process or outcome.

Process evaluation

Process evaluation questions focus on the training itself—things like the content, format, and delivery of the training.

Process evaluation question examples‎

1. To what extent does the training meet CDC's Quality Training Standards?


2. To what extent did the training reach the intended audience?


3. How can we make the training more engaging?

Outcome evaluation

Outcome evaluation questions focus on changes in the training participants – things like learning and the transfer of learning. For more information see Evaluate Training: Measuring Effectiveness.

Outcome evaluation question examples‎

1. How much did learners' knowledge increase?


2. To what extent were learning objectives met?


3. To what extent did learners apply what they learned when they returned to work after the training?

3. Choose the data collection methods

Choose data collection methods that will help you answer your evaluation questions. Commonly used data collection methods include:

  • observation
  • tests and quizzes
  • surveys or questionnaires
  • expert or peer review
  • interviews or focus groups

Identify how long it will take to access this data and how often you will collect it. Develop a timeline for when to collect, analyze, and interpret data so that you will have the information ready when you need it.

Keep feasibility in mind when you select data collection methods. The resources, time, and effort required should match the scope of the training and should fit within your available resources and timeline.

  • Patton MQ. Utilization-focused evaluation: The new century text. 3rd ed. Thousand Oaks, CA: Sage, 1997.