Test Development

The process of test development is rather involved. What makes good psychological tests good is usually lots of work in test development. The tremendous amount of work that goes into ensuring reliability and validity is what separates psychological tests from those found in popular magazines or used by unscrupulous people to get others to pay for some service such as therapy or personnel selection. Unfortunately, most of the work in test development is not visible in the final product. That is why we have test manuals and standards about what information appears in the manuals.

Phases of Development:

Conceptualization Ô Construction Ô Tryout Ô Item Analysis Ô Revision.

Conceptualization

What is the trait?

How will it be measured?

What is the purpose of the test? How will it be used? Do we need a new test of this? Is the new one going to be better than ones that already exist?

Test Construction

What content or stimulus situations should be included?

What format should be used?

How many items?

How to score the items?

Tryout

Who gets the test?

How Many?

Item Analysis: What items to remove?

Item-total correlations & discrimination indices (d)

Factor Analysis

Item-criterion correlations

Revision: What items to keep?

Choosing the final items

Creating new items

Revising items