Are your tests reliable? 4 types of reliability YouTube Lecture Handouts

Download PDF of This Page (Size: 227K)

Get video tutorial on: https://www.youtube.com/c/Examrace

Watch video lecture on YouTube: Are your tests reliable? 4 types of reliability Are Your Tests Reliable? 4 Types of Reliability
Loading Video

Test – Retest Reliability

Table of Student Data For Test A Reliability

Student ID

Exam score

Repeat score (same exam)

1

45

49

2

58

60

3

32

41

4

54

58

5

48

54

Parallel or Alternate Form Reliability

Table of Student Data For Parallel or Alternate Form Reliability

Student ID

Exam A score

Exam B score

1

57

58

2

54

56

3

41

45

4

32

41

5

58

57

Inter-Rater Reliability orInter-Observer Reliability orInter-Coder Reliability

  • Consensus in observations among different people (assuming observation are the same)

  • Degree of scoring stability a measure yields across multiple observers

  • Measure of agreement among raters

  • Improving Rater Reliability – Training/ Guided Revisions

What affects Inter-Rater Reliability?

  • Halo Effect (one dimension influencing others)

  • Stereotyping (impressions on group may influence individual)

  • Perception Differences (rater viewpoints and past experiences)

  • Leniency/Stringency Error (lack of knowledge)

Internal Consistency Reliability

Internal Consistency Reliability

  • Extent to which the items of a measure assess a common characteristic

  • Single measurement instrument administered to a group on one occasion

  • Estimate how well items that reflect the same construct yield similar results

  • How consistent the results are for different items for the same construct within the measure

Average Inter-Item Correlation

Average Item Total Correlation

Split Half ReliabilitySpearman–Brown prediction formula

Table of Student Data For Split Half Reliability

Student ID

Score on evenitems

Score on odditems

1

23

24

2

30

29

3

26

25

4

19

20

5

24

23

Cronbach Alpha (α)Average of all possible split-half correlations