Module 4: Practical Assignment Taking A Math Test

1. Different situations can contribute to random or systematic measurement error in test scores. Is it random or systematic error that contributes to the following situations?
An observer rating counseling behavior during a counselor-client interview tends to rate female counselors more highly than males on items dealing with client rapport- systematic error
B. An examinee taking a math test is distracted by noise in a nearby hallway and consequently makes an error in computing the answer- random error
2. On page 128-129, #2 provides data from a 3-item test given to 4 examinees (refer to the relevant table). Using these data, answer the following questions:
A. What is the true score for examinee 3?
(0*0)+(1*0)+(2*0.5)+(3*0.5)=2.5
B. What is the true score for examinee 2?
=(0*0.25)+( 1*0.25) (2*0.25) ( 3*0.25)= 1.5
F. What is the reliability coefficient for this test? (Look to Chapter 6, pg. 115-116 for a discussion of the reliability coefficient.)
Error Score

Variance

0.25

1.25

0.25

0.25


2

2/4=0.5
3. The definition of the true score states that each examinee has one true score value, which is the average observed score the examinee would earn over many repeated testings ON THAT PARTICULAR INSTRUMENT OR MEASURE.
John took two separate and completely different tests. How many “true scores” does he have? Why?
There are two true score for each test. The true score is the score John should actually have received if the test was taken multiple times.
4. For each situation, indicate the type of reliability estimate that would be most appropriate:
A. A classroom teacher wishes to check on the reliability of a multiple-choice final examination in biology.