Rating Methodology
The ratings in the Career Handbook were assigned by trained occupational analysts using a modified Delphi procedure. The goal of Delphi methodologies is to establish group consensus about unknown quantities or events. Ratings were based primarily on the Main Duties for each NOC unit group, but consideration was also given to the applicability of particular ratings for each job title listed as an example.
Statements in the Main Duties indicating that a unit group "may" undertake a specific duty or task were considered as less significant in assigning the rating, since this duty or task would apply only to some workers in the group.
After all unit groups had been rated, they were reorganized by ratings. For example, raters were presented with all unit groups coded as Location L1 (Inside regulated climate) or Vision 1 (Close visual acuity). Reorganization of the unit groups in this manner allowed for the identification of anomalous ratings and appropriate recoding.
The ratings on the Descriptor Scales address the criterion of skills for each occupation in the NOC classification system. In addition, this information provides some continuity with the CCDO. The Aptitude and DPT ratings were based on the compilation of seven-digit CCDO groups within NOC unit groups. The ratings assigned to groups reflect the most frequently occurring levels for aptitudes and worker functions for the CCDO compilations. These ratings were then subjected to the consensus procedure to accommodate, primarily, changes in technology in the workplace and the NOC’s occupational structure.
The Physical Activities and Environmental Conditions scales are revised scales that provide optimum information for the occupational emphasis of the NOC but maintain links to the scales used previously. These scales also provide a greater degree of delineation and specificity than the former scales.
The Interests and Education/Training Indicators represent new directions that diverge from the CCDO and reflect different theoretical principles. The CWPI is a five factor interest inventory that bases its ratings on the nature of the activities performed in an occupation. The three most relevant factors are assigned to each occupation in order of predominance. The CWPI does not propose a personality theory as the basis of ratings.
Education/Training Indicators reflect different types of education, training or combinations of these criteria, either required or possible, for entering occupations rather than the amount of time spent in training programs. Flexibility of programming instead of overall duration time, is a more important consideration confronting education and training providers as they attempt to accommodate the needs of their clients. The Career Handbook assigns the range of possible indicators that are relevant for an occupational group, thereby identifying the various sources of supply for occupations.