Description of Test Validation Procedure:
Pre-Existing Technical Test

A. Job Analysis

The job description for the pre-existing test is compared with the description for the new job.  Ten job experts review the description to ensure its similarity to the new description.


B. Completion of Maintenance Activity List

The ten job experts rate the job with respect to importance of job activities and percent of time spent on job activities.  Ramsay Corporation evaluates the interrater agreement.


C. Editing of Knowledge and Skills Areas

The job experts review the list of knowledge and skills areas to eliminate any which are not related to the new job.  They add any areas which are not present.


D. Review of Test

Job experts review the pre-existing test item by item.  They judge each item’s relatedness to the new job.


E. Angoff Procedures To Set Cutting Scores and Review Final Test

Five to ten job experts review the test item-by-item.  If the job experts change or eliminate many of the test items, then the modified Angoff method would be used.  They select the correct answer, they are told the keyed answer, and they are asked what percent of qualified candidates would pass each item.  This is also their final review of the total test before final printing.


F. Writing of Summary Content Validation Report

Ramsay Corporation writes a summary content-related validation report in the format suggested by the Uniform Guidelines on Employee Selection Procedures.  The company reviews a draft.  The final report detailing the activities undertaken is then bound and provided to the client.