Unit 3: Training methods & evaluation
Training and Development notes · PTU syllabus (BBA-631)
On this page
Unit summary
Choosing the right method decides whether learning happens, and evaluation proves whether it worked. This unit covers traditional and modern training methods, the use of technology in training, reasons for and the process of evaluation, outcomes used for evaluation (Kirkpatrick's levels), and evaluation practices and designs.
After this unit you can
- Classify and explain traditional training methods
- Explain modern and technology-based training methods
- Explain the reasons for and process of training evaluation
- Apply Kirkpatrick's four levels and evaluation designs
PTU syllabus topics
- Traditional and modern training methods
- use of technology in training
- reasons for and process of training evaluation
- outcomes used for evaluation
- evaluation practices
- Results
Business impact
- Behaviour
On-the-job change
- Learning
Knowledge and skills gained
- Reaction
Did trainees like it?
Topic 1
Traditional training methods
On-the-job
Job instruction training, coaching, mentoring, job rotation, apprenticeship, understudy
Off-the-job
Lectures, case study, role play, simulation, vestibule training, conferences
On-the-job methods
- Job Instruction Training (JIT): step-by-step — prepare the trainee, present the task, try out performance, follow up.
- Apprenticeship: classroom plus on-the-job learning for skilled trades (Apprentices Act, 1961).
- Coaching: supervisor guides and gives feedback.
- Mentoring: a senior guides a junior's career and development.
- Job rotation: moving across jobs to learn varied skills.
- Understudy: trainee assists a senior and is prepared to replace them.
Off-the-job methods
- Lecture method: large groups, low cost; one-way, passive.
- Vestibule training: a replica of the work setting away from the floor (bank teller simulators, airline cabin mock-ups).
- Audio-visual methods: films, videos, demonstrations.
- Programmed instruction: material in small steps with immediate feedback.
Location
At the workplace
Away from the workplace
Cost
Low
Higher
Realism
Real conditions, direct transfer
Simulated, may not transfer
Disturbance
May disrupt production
No disruption
Suits
Operational skills
Conceptual and managerial skills
Topic 2
Modern methods and use of technology in training
- E-learning: web-based courses through a Learning Management System (LMS) — self-paced, tracked.
- Blended learning: mix of classroom and online.
- Virtual instructor-led training (VILT): live sessions on Zoom or Teams.
- Mobile learning and microlearning: short 3–5 minute modules on phones.
- Simulations and serious games: realistic practice without risk.
- Virtual reality (VR) and augmented reality (AR): immersive training for pilots, surgeons, machine operators.
- AI-based adaptive learning: content adjusts to the learner's performance; chatbots answer questions.
- MOOCs: SWAYAM, Coursera, LinkedIn Learning for upskilling.
- Gamification: points, badges, leaderboards to motivate learners.
Flexibility
Anytime, anywhere learning
Scalability
Train thousands consistently
Cost savings
Lower travel and venue costs
Tracking
Data on progress and completion
Exam tip
Limitations to mention: high initial cost, need for digital literacy, less human interaction, distractions and low completion rates.
Topic 3
Reasons for and process of training evaluation
Training evaluation is the systematic collection of information to judge whether training achieved its objectives and was worth the cost.
Reasons
- Identify strengths and weaknesses of the programme.
- Check whether objectives were met.
- Justify the investment (ROI) to top management.
- Decide whether to continue, modify or drop a programme.
- Identify which trainees benefited most.
- Improve future programmes and trainer performance.
- 1
Conduct needs analysis
- 2
Develop measurable learning outcomes
- 3
Develop outcome measures
- 4
Choose an evaluation strategy (design)
- 5
Plan and execute the evaluation
- 6
Analyse results and report
Topic 4
Outcomes used for evaluation
- Level 4 Results
Business impact — productivity, quality, sales, cost
- Level 3 Behaviour
Transfer — change in on-the-job behaviour
- Level 2 Learning
Knowledge, skills and attitudes gained (tests)
- Level 1 Reaction
Trainees' satisfaction (feedback forms)
- Level 5 — ROI (Jack Phillips): converts results into money and compares with cost.
- Other outcomes: cognitive (knowledge), skill-based (technical and motor skills), affective (attitudes, motivation), results, ROI.
- CIRO model (Warr, Bird and Rackham): Context, Input, Reaction, Outcome evaluation.
Example
After customer-service training: Level 1 — 90% rate it useful; Level 2 — test scores rise from 55 to 80; Level 3 — mystery shopper scores improve; Level 4 — complaints fall 30%.
Topic 5
Evaluation practices and designs
| Design | Description | Strength | Weakness |
|---|---|---|---|
| Post-test only | Measure after training | Simple, cheap | No baseline |
| Pre-test / post-test | Measure before and after | Shows change | Change may be due to other factors |
| Pre/post with comparison group | Trained and untrained groups both measured | Controls other factors | Needs a comparable group |
| Time series | Repeated measures before and after | Shows trends | Time-consuming |
| Solomon four-group | Combines designs to control for testing effects | Most rigorous | Complex, costly |
- Threats to validity: history (other events), maturation, testing effects, selection differences, trainee drop-out.
- Practices in industry: most organisations measure reaction (Level 1) and learning (Level 2); fewer measure behaviour and results because they are harder.
Exam tip
Recommend using a comparison group wherever possible — it is the best answer to "how can evaluation be made more accurate?"
Key terms
- Vestibule training
- Training on equipment in a replica of the work area away from the shop floor
- LMS
- Learning Management System that delivers and tracks online training
- Blended learning
- Combination of classroom and online learning
- Training evaluation
- Judging whether training met its objectives and was worth the cost
- Kirkpatrick model
- Four levels of evaluation — reaction, learning, behaviour, results
Quick revision
- On-the-job: JIT, coaching, mentoring, rotation, apprenticeship.
- Off-the-job: lecture, case, role play, simulation, vestibule.
- Modern: e-learning, VILT, microlearning, VR/AR, gamification, AI.
- Kirkpatrick: reaction → learning → behaviour → results (+ ROI).
- Designs: post-test, pre/post, comparison group, time series, Solomon.
Important exam questions
Practice questions written to the PTU exam pattern for this unit's syllabus: short answers (Section A style) and long answers (Sections B and C style).
Short-answer questions
- Q1.What is job instruction training?
- Q2.What is vestibule training?
- Q3.Define e-learning.
- Q4.Why is training evaluated?
- Q5.Name Kirkpatrick's four levels of evaluation.
- Q6.What is a pre-test/post-test design?
Long-answer questions
- Q1.Explain the on-the-job and off-the-job methods of training.
- Q2.Discuss the use of technology in training.
- Q3.Explain the process of training evaluation and the reasons for evaluation.
- Q4.Explain Kirkpatrick's model of training evaluation and the evaluation designs.
Stuck on this unit?
Message SBS on WhatsApp for help with Training and Development, or to ask about studying BBA at Synetic.