Are your tests reliable? 4 types of reliability YouTube Lecture Handouts

Download PDF of This Page (Size: 227K)

Get video tutorial on: https://www.youtube.com/c/Examrace

Watch video lecture on YouTube: Are your tests reliable? 4 types of reliability Are Your Tests Reliable? 4 Types of Reliability
Loading Video
Image of Types of Reliability

Image of Types of Reliability

Image of Types of Reliability

Test – Retest Reliability

Image of Test - Retest Reliability

Image of Test - Retest Reliability

Image of Test - Retest Reliability

Table of Student Data for Test a Reliability
Table of Student Data For Test A Reliability

Student ID

Exam score

Repeat score (same exam)

1

45

49

2

58

60

3

32

41

4

54

58

5

48

54

Parallel or Alternate Form Reliability

Table of Student Data for Parallel or Alternate Form Reliability
Table of Student Data For Parallel or Alternate Form Reliability

Student ID

Exam A score

Exam B score

1

57

58

2

54

56

3

41

45

4

32

41

5

58

57

Inter-Rater Reliability orInter-Observer Reliability orInter-Coder Reliability

Image of Object or Phenomenon

Image of Object or Phenomenon

Image of Object or Phenomenon

  • Consensus in observations among different people (assuming observation are the same)

  • Degree of scoring stability a measure yields across multiple observers

  • Measure of agreement among raters

  • Improving Rater Reliability – Training/ Guided Revisions

What Affects Inter-Rater Reliability?

  • Halo Effect (one dimension influencing others)

  • Stereotyping (impressions on group may influence individual)

  • Perception Differences (rater viewpoints and past experiences)

  • Leniency/Stringency Error (lack of knowledge)

Internal Consistency Reliability

Internal Consistency Reliability

  • Extent to which the items of a measure assess a common characteristic

  • Single measurement instrument administered to a group on one occasion

  • Estimate how well items that reflect the same construct yield similar results

  • How consistent the results are for different items for the same construct within the measure

Average Inter-Item Correlation

Image of Average Inter-Item Correlation

Image of Average Inter-Item Correlation

Image of Average Inter-Item Correlation

Average Item Total Correlation

Image of Average Item Total Correlation

Image of Average Item Total Correlation

Image of Average Item Total Correlation

Split Half ReliabilitySpearman–Brown prediction formula

Image of Split Half Reliability

Image of Split Half Reliability

Image of Split Half Reliability

Table of Student Data for Split Half Reliability
Table of Student Data For Split Half Reliability

Student ID

Score on evenitems

Score on odditems

1

23

24

2

30

29

3

26

25

4

19

20

5

24

23

Cronbach Alpha (α)Average of all possible split-half correlations

Image of Average of All Possible Split - Half Correlations

Image of Average of All Possible Split - Half Correlations

Image of Average of All Possible Split - Half Correlations