Certification
Training
About Us
News
Articles
Contact Us

The Minds in Action

Statistical Test Analysis

Is your Professional Certification Test effectively discriminating between qualified and less than qualified certification candidates?

Does every item on your test positively contribute to the assessment of the skills of your certification candidates?

Is your Professional Certification Test written to the appropriate level of difficulty?

Have changes brought on by the passage of time eroded the ability of your test to predict performance?

The Minds in Action Statistical Test Analysis can help you determine if your Professional Certification Test is performing its job of evaluating the qualifications of your certification candidates.  By using the Statistical Test Analysis, you can identify specific items on your Professional Certification Test that are performing well and items that are not effectively distinguishing between qualified and less than qualified certification candidates.  In addition, the Minds in Action Statistical Test Analysis can determine if your test is written to the appropriate level of difficulty and is of the appropriate length.  Armed with this information, you can revise problem items to deliver an even better Professional Certification Test.

Overview:

Using item response data that you provide, Minds in Action will evaluate every item on your test for:

Difficulty.  Each test item should contribute to the determination of whether the candidate is qualified or less than qualified for certification.  Items that are too easy do not distinguish between the qualified and less than qualified because members of both groups are likely to answer the item correctly.  Items that are too difficult also fail to distinguish between qualified and less than qualified individuals because a large number of qualified individuals will get the item wrong.  Your Professional Certification Test should attempt to include items that are at a level of difficulty that clearly distinguish between qualified and less than qualified individuals.

Discrimination.  Every test item should effectively discriminate between qualified and less than qualified certification candidates.  Ideally, individuals who earn high scores on the overall test should answer a given item correctly.  Lower scoring individuals should answer the same item incorrectly.  If the Statistical Test Analysis finds that, for a given item, overall high scorers answer a test item incorrectly and overall low scorers answer the same item correctly, the item suffers from "reverse discrimination".  These items are undesirable because they don't discriminate between qualified and less than qualified individuals.  In fact, they do the opposite - they reward less than qualified individuals and penalize those who are qualified.  It is obvious that these items should be repaired or removed from the Professional Certification Test item pool.

Reliability.  In instances in which multiple test forms are presented to certification candidates, you must ensure that each test form is equivalent to the others in terms of difficulty and discrimination.  Minds in Action Statistical Test Analysis will analyze each of your test forms for reliability, and make recommendations for changes, if necessary.

Problem Test Items.  The Minds in Action Statistical Test Analysis will uncover specific problems that affect your test items.  For example, a multiple choice test question with four answer options typically offers the test taker a one in four chance of guessing the correct answer.  However, if two of the incorrect answer options are not being selected by any of the test takers, the effective odds of guessing the correct answer rises to one in two.  Obviously, this test item is less likely to distinguish between qualified and less than qualified candidates than other test items.  Minds in Action will review the results of the Statistical Test Analysis for each item on your Professional Certification Test and point out areas in which the test item may be improved.

Validity.  The validity of your Professional Certification Test rests upon the quality of individual test items.  The Minds in Action Statistical Test Analysis can help you identify test items that effectively distinguish between qualified and less than qualified individuals.  More importantly, the Statistical Test Analysis will reveal problem test items, and recommend areas in which specific problem items can be repaired.

Upon completion of the Statistical Test Analysis, Minds in Action will provide you with a comprehensive report detailing the findings for every item on your Professional Certification Test or assessment.  This report will include suggestions on improving problem items that can be repaired and a list of items that should be deleted from the item pool.

Purpose:

The Minds in Action Statistical Test Analysis is intended to ensure that your Professional Certification Test or assessment is a valid and reliable predictor of performance on the job.  It identifies test items that effectively distinguish between qualified certification candidates and those who are less than qualified.

The Minds in Action Statistical Test Analysis serves two primary purposes:

Validates the Quality of Your Professional Certification Test.  The Minds in Action Statistical Test Analysis determines if your Professional Certification test is a valid and reliable tool that distinguishes between qualified and less than qualified certification candidates.  By regularly analyzing the performance of individual test items, you enhance your ability to defend the quality of your test to those who challenge its effectiveness.  The Statistical Test Analysis allows you to prove that your Professional Certification Test is an effective measure of the qualifications of your certification candidates.

Allows You to Identify and Repair or Replace Problem Test Items.  Problem test items appear even in the best developed Professional Certification Tests.  Technical or cultural nuances that effect a candidate's interpretation of a specific test item may be overlooked in the test development process.  Changes in the profession that occur over time might change the correct answer to a specific test item or render it obsolete.  Regardless of the cause, problem test items weaken the quality of your Professional Certification Test and its acceptance by your constituencies.  By conducting regular analysis of your Professional Certification Tests, you are ensuring that problem test items are identified so they can be repaired, replaced, or deleted from your test item pool.

Benefits:

Sponsoring a Minds in Action Job Statistical Test Analysis can provide the following benefits to your organization:

bullet The Minds in Action Statistical Test Analysis will validate the quality of your Professional Certification Test or assessment.
bullet Ensures that every item in your Professional Certification Test or assessment reliably validates the ability of an individual to earn your Professional Certification credential.
bullet Ensures that items in your Professional Certification Test or assessment do not grow obsolete over time.
bullet Allows you to improve the quality of your Professional Certification Test or assessment by identifying problem test items.
bullet Allows your organization to provide statistical evidence of the validity and reliability of your test in the event of challenges.
bullet Ensures that every test item is written to the appropriate level of difficulty.
bullet Increases acceptance of your Professional Certification test or assessment.
 

Information Request Form

Select the items that apply, and then let us know how to contact you.

Send company literature
Have a representative contact me
Send service literature on:

Professional Certification Program Development Services:
    Business Initiatives Development Workshop
    Job Task Analysis Workshop
    Objectives Ranking and Blueprinting Services
    Test Item Writing Workshop
    Test Technical Review Workshop
    Statistical Test Analysis

Training Program Development Services
    Business Initiatives Development Workshop
    Training Program Evaluation Services
    Job Task Analysis Workshop
    Objectives Ranking Services
    Curriculum and Course Blueprinting Workshop
    Course Technical Review Workshop
    Course Check-Up
 

Please provide the following contact information:

Honorific
First Name
Middle Name or Initial
Last Name
Suffix (Sr., Jr. II, III, etc.)
Job Title
Organization
Street Address
Address (cont.)
City
State/Province
Zip/Postal Code
Country
Work Phone
E-mail

Additional comments, questions, requests for other services, or details about your requirements:




 

Send mail to Minds in Action with questions or comments about this web site.
Copyright 2000 - 2007 Minds in Action, Inc. and its licensors.  All rights reserved.
Last modified: 05/06/07