An automated system of test construction is under development that involves accessing a large bank of test item data. In support of this development this study examined test material which, with the exception of a biographical inventory, covered a wide spectrum of cognitive abilities. The objective was to determine the kinds of test items that are most relevant for use in screening and classification for current aviation specialties, and thus to establish guidelines for investments into the test item bank. By means of a series of factor analyses of test scores and criterion data five cognitive ability factors and a motivational factor were identified. The potential discriminatory validity of each factor was defined for the Naval Flight Officer (NFO) and pilot programs, and for various specialties within these programs.