Are Your Tests Reliable? 4 Types of Reliability YouTube Lecture Handouts

Glide to success with Doorsteptutor material for competitive exams : get questions, notes, tests, video lectures and more- for all subjects of your exam.

Get video tutorial on: Examrace YouTube Channel

Are your tests reliable? 4 types of reliability

Illustration: Are Your Tests Reliable? 4 Types of Reliability YouTube Lecture Handouts

Test – Retest Reliability

Illustration: Test – Retest Reliability
Table of Student Data for Test a ReliabilityTable of Student Data for Test a Reliability
Student IDExam scoreRepeat score (same exam)
14549
25860
33241
45458
54854

Parallel or Alternate Form Reliability

Table of Student Data for Parallel or Alternate Form ReliabilityTable of Student Data for Parallel or Alternate Form Reliability
Student IDExam A scoreExam B score
15758
25456
34145
43241
55857

Inter-Rater ReliabilityorInter-Observer ReliabilityorInter-Coder Reliability

Illustration: Inter-Rater ReliabilityorInter-Observer ReliabilityorInter-Coder Reliability
  • Consensus in observations among different people (assuming observation are the same)
  • Degree of scoring stability a measure yields across multiple observers
  • Measure of agreement among raters
  • Improving Rater Reliability – Training/Guided Revisions

What Affects Inter-Rater Reliability?

  • Halo Effect (one dimension influencing others)
  • Stereotyping (impressions on group may influence individual)
  • Perception Differences (rater viewpoints and past experiences)
  • Leniency/Stringency Error (lack of knowledge)

Internal Consistency Reliability

Internal Consistency Reliability

  • Extent to which the items of a measure assess a common characteristic
  • Single measurement instrument administered to a group on one occasion
  • Estimate how well items that reflect the same construct yield similar results
  • How consistent the results are for different items for the same construct within the measure

Average Inter-Item Correlation

Illustration: Average Inter-Item Correlation

Average Item Total Correlation

Illustration: Average Item Total Correlation

Split Half Reliability

Spearman – Brown prediction formula

Illustration: Average Item Total Correlation
Table of Student Data for Split Half ReliabilityTable of Student Data for Split Half Reliability
Student IDScore on even

items

Score on odd

items

12324
23029
32625
41920
52423

Cronbach Alpha (α)

Average of all possible split-half correlations

Illustration: Average Item Total Correlation

Manishika