Validity and Reliability of Assessments PDF Print E-mail

A large body of research has supported the reliability and validity of the Style Analysis and the DISC dimensions. This research has provided evidence of high test-retest reliability (the stability of test scores over time); strong construct validity (the relationship of the Style Analysis to other tests measuring similar constructs); robust content validity (how well the DISC dimensions measure what they are supposed to measure); significant criterion or predictive validity (the ability of the DISC dimensions to predict performance on another activity); and powerful construct validity (the extent to which the DISC dimensions measure a specific trait.)

The research findings on test-retest reliability show that the scores on the Style Analysis exhibit very little change over time. Six-month rest-retest correlations average in the .90 range where a correlation of 1.0 is a perfect relationship (absolutely no change) and .0 is no relationship (random change). The Style Analysis is a reliable instrument that consistently measures the same thing.

Construct and concurrent validity studies have compared the Style Analysis with other Four Factor instruments such as the Activity Vector Analysis, Personal Profile Analysis and Cleaver Self. Significant correlations have been found across all four DISC dimensions. This indicates the Style Analysis validly assesses constructs measured by other Four Factor assessment instruments.

Research on content validity has shown that the DISC dimensions can differentiate good performances from poor performances. This ability to differentiate has been shown in studies of sales performance and managerial ability in a number of industries. The Style Analysis can successfully distinguish varying levels of performance.

Criterion or predictive validity studies have looked at the ability of various DISC dimensions to predict outcomes. Outcome measures as diverse as sales performance, turnover rates and job injuries have been predicted with a high degree of accuracy on the basis of DISC scores. This ability to predict makes the Style Analysis a very valuable tool in selection and management.

Strong Construct Validity is shown when the instrument consistently exhibits content validity, concurrent validity and predictive validity. The research shows the Style Analysis to be a construct valid instrument.

A recent study provides an excellent example of validity of the DISC dimensions of the Style Analysis. Top sales people (N=166) were compared with a large sample of other professional workers (N=3448) on the DISC. The two groups were found to differ significantly on all DISC dimensions in both Natural and Adapted style. Each of the dimensions for the DISC contributed to the ability to distinguish top sales people from other workers. In addition, both Natural and Adapted style scores added to the ability to predict job performance. This study showed that the Style Analysis can identify specific characteristics that are predictive of success.

A review of the extensive research that has been conducted on the Style Analysis conclusively shows that the Style Analysis Instrument is a reliable and valid assessment device with a wide range of applications.�

Source: The Style Analysis™ Validity Study by Target Training International, Ltd.�