Classical Test Theory: A Comprehensive Guide for Multiple Choice Item Evaluation

Question 1

Which of the following is a core assumption of Classical Test Theory (CTT)?

Accepted Answer

Test scores are assumed to be continuous and normally distributed.

Answer

Test scores are discrete and follow a binomial distribution.

Answer

Test scores are ordinal and can only be compared within the same group.

Question 2

What is the primary purpose of item analysis within the framework of CTT?

Accepted Answer

To identify and enhance items that perform poorly, contributing to a more effective assessment.

Answer

To estimate the reliability and validity of the test.

Answer

To determine the cut-off score for passing the test.

Answer

To compare the performance of different groups on the test.

Question 3

What is the fundamental purpose of establishing validity evidence in CTT?

Accepted Answer

To demonstrate that the test accurately measures the intended construct or skill.

Answer

To estimate the reliability of the test.

Answer

To determine the cut-off score for passing the test.

Question 4

What is the relationship between reliability and validity in CTT?

Accepted Answer

A test cannot be valid if it is not reliable, but a test can be reliable without being valid.

Answer

Reliability and validity are independent of each other in CTT.

Answer

A test must be both reliable and valid to be considered useful.

Question 5

How can CTT be utilized to enhance the quality of a test?

Accepted Answer

By identifying and removing underperforming items, and revising the test content to ensure alignment with the intended purpose.

Answer

By setting cut-off scores for passing the test.

Question 6

What are the primary differences between CTT and Item Response Theory (IRT)?

Accepted Answer

CTT assumes all items are equally difficult, while IRT acknowledges varying levels of item difficulty. CTT provides estimates of test reliability and validity, while IRT focuses on item and person parameter estimates.

Answer

CTT is only applicable to multiple-choice tests, while IRT can be used with any type of test item.