Sign in / Register
CONTACT US:(801) 537-7800

Expert Measurement & Evaluation Strategies

Any training program you develop is only as good as the results you get. You need strategies to measure training effectiveness. You need training metrics to determine whether your methods improve employee performance, lead to desired outcomes, and create positive impact at scale.
 
At AllenComm, our expert instructional designers develop your training with learning measurement and training evaluation in mind. We use an in-depth needs analysis and performance mapping to better understand our clients’ challenges and needs.
 
We develop a strategy to link performance behaviors with goals for ROI and create a custom learning solution around a set of specific, pre-defined training metrics. Together, we set the benchmarks you need to build a successful training program, continue with improvements over time, and automate the training evaluation process.
 
Work with us to be sure you’ll see measurable results from your training programs.

Case Study

Korn Ferry

The training had to empower learners with the skills to exceed performance expectations through use of competency-based SMART goals. The courses provided foundational knowledge, clear guidance, and modeling for competencies that would be integrated into the flow of work.

View case study

Challenges to Measuring Learning's Impact

Very few learning organizations identify and track training metrics that are tied to business results (i.e. behavior change, and business impact).

Brandon Hall Group’s 2021 Learning Measurement Study found that the greatest challenges for a business organization to measure the impact of learning include:

  • Lack of proper training metrics
  • Shortage of time/staff
  • Not having the technology to support it
  • Struggle to link learning to outcomes
  • Difficult to assess training metrics
  • Not seeing a need for training metrics

Our Performance Mapping Process

The AllenComm performance mapping process defines four levels of training metrics to evaluate the success of your learning solution (per Kirkpatrick’s Four Levels of Evaluation):

  1. Reaction – Gauges overall learner sentiment and satisfaction with the training by measuring engagement, relevancy, confidence level, complexity, and usability (data from surveys, interviews, help desk)

  2. Learning Outcomes– Evaluates whether the skills or knowledge were learned (data from pre- and post-exam, scored activities)

  3. Performance Results – Measures observable changes in behavior (operational data or score cards)

  4. Business Impact – Assesses the impact on the business (increased sales, decreased operational costs)

Developing A Learning Measurement Strategy

1. Plan

The first step to develop an effective strategy is to begin by identifying the business goal that is going to be served by the training, in order to make sure that the learning solution is the right fit for the intended goal. It is important to think about training metrics to help guide your path forward before you design the training.

Involving business partners at this stage will help create alignment of strategy and goals, and promote the buy-in that will allow you to create a training effectiveness baseline pre-launch to measure against after the training is launched. Change management planning is essential to success.

2. Measure

After completing the plan, the next step is to gather and report on the data using visualizations. It will be important to consider whether to collect both engagement and performance data. Keep in mind that you will not be able to measure the same training metric for every learning solution; it depends on the intervention. It is best to consider what the Key Performance Indicators (KPIs) are that are indisputable, easy to get measurement from, and that can be acted on. You may want to consider the following to determine the KPIs:

1. Use the generated reports and visualizations to analyze trends. You may compare a learner’s activity with others in the same program, with learners who have previously taken the course, or against the course rubrics.

2. Empathy interviews, with end users, managers, stakeholders and other benefactors, as part of a design thinking process, are powerful on the front end and throughout the development process to gather qualitative results.

Make sure you are intentional in the data that you are collecting. Gathering data you won’t use in your training evaluation is wasteful and can cause confusion.

3. Act

Once you have collected and analyzed the data from your training metrics, you will find areas to improve the learning solution over time. Create checkpoints to gather data to show improvement regular intervals, such as 30 days, 60 days, and 90 days. This way you will be able to iterate your training to improve it overtime.

Most importantly, remember that the way to engage employees is to provide them with opportunities to learn and develop new competencies. Research suggests that lifelong learning contributes to happiness. When highly engaged employees are challenged and given the skills to grow and develop within their chosen career path, they are more likely to be energized by new opportunities at work and satisfied with their current organization.

Working with our clients, we use diagnostics to track the desired performance impact and to make iterative improvements on the effectiveness of the learning solutions over time.