M06-06 · AI + Learning & Training Design

Learning Measurement and Evaluation

Teaches students to measure whether training actually works — not just whether people liked it. Covers the Kirkpatrick model (L1 Reaction through L4 Results), assessment design that tests application rather than recall, pre/post measurement, A/B testing of course designs, connecting L&D metrics to business outcomes, and presenting ROI to leadership. Students learn that measurement is what transforms L&D from a cost center into a strategic function.

25 Hours

7 Learning objectives

Evaluate Bloom's ceiling (?)

5 Competencies

What You'll Be Able To Do

Learning Objectives

Objectives

Depth

Apply the Kirkpatrick model to design measurement at all four levels: L1 Reaction (satisfaction surveys), L2 Learning (pre/post assessments), L3 Behavior (30/60/90-day follow-ups with managers), and L4 Results (business outcome correlation) Apply
Design scenario-based assessments that test application and judgment rather than recall — where learners must make decisions in realistic situations, not select definitions from a list Create
Create pre/post assessment pairs that measure learning gain: equivalent difficulty, aligned to objectives, administered before and after training to isolate the training effect Create
Design and execute A/B tests on course designs: old version vs. redesigned version, tracking completion rates, assessment scores, satisfaction ratings, and time to completion Apply
Analyze when L3 (behavior) and L4 (results) measurement is feasible vs. when the cost and complexity outweigh the insight, and propose measurement plans with appropriate scope and caveats Evaluate
Calculate and present L&D ROI to leadership: training completion vs. benchmarks, pre-to-post score improvement, behavior change indicators, and early business outcome correlations — with explicit caveats on causation Apply
Evaluate survey and assessment data for validity threats: quiz fatigue, social desirability bias in satisfaction surveys, ceiling effects in easy assessments, and Hawthorne effects in observed behavior change Evaluate

Levels: Remember · Understand · Apply · Analyze · Evaluate · Create — highest demands most original thinking.

Core Competencies

What You'll Master

Kirkpatrick Application

Designing measurement at each level, knowing which levels to apply to which training types, and managing the cost/value tradeoff of deeper measurement.

Assessment Design

Scenario-based items, distractor design that tests common misconceptions, pre/post measurement, item difficulty calibration.

A/B Testing for Learning

Designing controlled comparisons of course designs, selecting metrics, interpreting results with appropriate statistical rigor.

L&D ROI Presentation

Translating measurement data into leadership-ready narratives that demonstrate training value and justify budget.

Measurement Validity

Identifying threats to measurement accuracy and designing around them.

Portfolio Artifact

What You'll Build

Learning Measurement Plan and Results Report — Student designs a complete measurement plan for a training program: Kirkpatrick levels applied (with rationale for which levels), assessment instruments (pre/post with 10 scenario-based items each), L1 survey design, L3 behavior follow-up plan, and L4 outcome metrics with isolation caveats. Then analyzes provided measurement data (simulated pre/post scores, completion rates, satisfaction surveys, behavior indicators) and produces an L&D ROI report suitable for presentation to a VP — including A/B comparison results, visualizations, and explicit language about what the data shows vs. what it cannot prove.

Tools You'll Use

Industry Tools, Not Toy Projects

SurveyMonkey / Google Forms

Survey platforms for L1 evaluation design, learner satisfaction measurement, and feedback collection.

Google Sheets / Excel

Data analysis tools for processing assessment results, computing metrics, and building measurement dashboards.

LMS Reporting

Learning management system reports for completion data, assessment scores, and learning path progression.

Claude

AI assistant for assessment item generation, ROI narrative drafting, and measurement plan design.

Google Slides

Presentation tool for building leadership-ready L&D ROI reports and measurement results presentations.