Are Your Tests Reliable? 4 Types of Reliability YouTube Lecture Handouts
Glide to success with Doorsteptutor material for competitive exams : get questions, notes, tests, video lectures and more- for all subjects of your exam.
Get video tutorial on: Examrace YouTube Channel
Are your tests reliable? 4 types of reliability
Test – Retest Reliability
Student ID | Exam score | Repeat score (same exam) |
1 | 45 | 49 |
2 | 58 | 60 |
3 | 32 | 41 |
4 | 54 | 58 |
5 | 48 | 54 |
Parallel or Alternate Form Reliability
Student ID | Exam A score | Exam B score |
1 | 57 | 58 |
2 | 54 | 56 |
3 | 41 | 45 |
4 | 32 | 41 |
5 | 58 | 57 |
Inter-Rater ReliabilityorInter-Observer ReliabilityorInter-Coder Reliability
- Consensus in observations among different people (assuming observation are the same)
- Degree of scoring stability a measure yields across multiple observers
- Measure of agreement among raters
- Improving Rater Reliability – Training/Guided Revisions
What Affects Inter-Rater Reliability?
- Halo Effect (one dimension influencing others)
- Stereotyping (impressions on group may influence individual)
- Perception Differences (rater viewpoints and past experiences)
- Leniency/Stringency Error (lack of knowledge)
Internal Consistency Reliability
Internal Consistency Reliability
- Extent to which the items of a measure assess a common characteristic
- Single measurement instrument administered to a group on one occasion
- Estimate how well items that reflect the same construct yield similar results
- How consistent the results are for different items for the same construct within the measure
Average Inter-Item Correlation
Average Item Total Correlation
Split Half Reliability
Spearman – Brown prediction formula
Student ID | Score on even items | Score on odd items |
1 | 23 | 24 |
2 | 30 | 29 |
3 | 26 | 25 |
4 | 19 | 20 |
5 | 24 | 23 |
Cronbach Alpha (α)
Average of all possible split-half correlations
✍ Manishika