The International Journal of Interdisciplinary Organizational Studies

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Retention in the Canadian Armed Forces: The Predictive Validity of Three Selection Measures


Affiliations
1 National Defence, Canada
     

   Subscribe/Renew Journal


This study examined the predictive validity of the Canadian Forces Aptitude Test (CFAT), educational levels, and the Military Potential (MP) score in predicting retention in the Canadian Armed Forces (CAF). This set of selection measures is fundamental to CAF selection process. The CFAT is a cognitive test that assesses verbal skills, spatial ability, and problem solving ability. The MP score is derived from candidates' performance at a semi-structured interview and their application materials (biographical information, CFAT scores, and educational achievement). The criterion of retention in this research was basic training completion on first attempt. Analyses were performed on data from 14,381 recruits enrolled between fiscal years 04/05 and 08/09. A series of unadjusted logistic regressions were conducted to examine the effects of each measure individually. Then adjusted logistic regressions were conducted to examine the impact of each measure after controlling for the others and for demographic variables (gender and age). All analyses were conducted separately for officers and Non-Commissioned Member (NCM) recruits. Overall, for officer recruits, results from unadjusted logistic regression indicated that high CFAT scores were positively associated with completion of basic training but higher education levels were negatively associated with completion of basic training. However, these relationships did not hold in adjusted logistic regression where only gender and age emerged as significant. For NCM recruits, results of unadjusted logistic regression showed that CFAT scores, and having a high school diploma or higher degree was positively associated with basic training completion and these relationships remained significant in adjusted logistic regression. A positive relation was also found between MP score and basic training completion for NCM recruits, but these relationships were no longer significant in adjusted logistic regression. More studies are needed to fully understand the relative role of all CAF selection measures to the prediction of other retention and performance-related criteria.

Keywords

Retention, Cognitive Test, Interview, Education, Military.
Subscription Login to verify subscription
User
Notifications
Font Size


  • Barrick, Murray R. and Ryan D. Zimmerman. 2005. "Reducing Voluntary, Avoidable Turnover through Selection." Journal of Applied Psychology 90 (1): 159-166.

  • Barrick, Murray R. and Ryan D. Zimmerman. 2009. "Hiring for Retention and Performance." Human Resource Management 48 (2): 183-206.

  • Boswell, Richard and Captain Frank Kuschnereit. 2009. "Canadian Forces Aptitude Test Manual.". Director General Military Personnel Research and Analysis Contract Report2009-002, Ottawa, Ontario, Canada.

  • Buddin, Richard J. 1984. "Analysis of Early Military Attrition Behavior." Santa Monica California: RAND Corporation.

  • Buddin, Richard J. 2005. "Success of First-Term Soldiers: The Effects of Recruiting Practices and Recruit Characteristics." Santa Monica: California: RAND Corporation.

  • Elster, Richard S. and Eli S. Flyer. 1982. "A Study of Relationship between Educational Credentials and Military Performance Criteria." Monterey, California: Naval Postgraduate School.

  • Fang, Manchun and Sonia A. Latchman. 2008. "Cohort Analysis of New Recruit Attrition." Director General Military Personnel Research and Analysis. Briefing Note for Chief Military Personnel. Ottawa, Ontario, Canada.

  • Girard, Marcel L. 2009. "Principal Components Analysis of Interview Questions Used in Selection of Canadian Forces Personnel." Director General Military Personnel Research and Analysis Technical Note 2009-003. Ottawa, Ontario, Canada.

  • Grandmaison, Laurence J. and Anthony J. Cotton. 1994. "An Empirical Review of the Military Potential Rating of Non-Commissioned Member Applicants." Director Human Resources Research and Evaluation Technical Note 11-94. Ottawa, Ontario, Canada.

  • Jennings, Elyse and Nehama Babin. 2007. "Annotated Bibliography: Research on Enlisted Attrition in the U.S. Army." United States Army Research Institute for the Behavioral and Social Sciences ARI Research Note 2007-06.

  • Kubisiak, Christean, U., Elizabeth Lentz, Kristen E. Horgen, Rebecca H. Bryant, Patricia W. Connell, Matthew D. Tuttle, Walter C. Borman, Mark C. Young, and Ray Morath. 2009. "Review of Interventions for Reducing Enlisted Attrition in the U.S. Military: An Update." United States Army Research Institute for the Behavioral and Social Sciences ARI Research Note 2009-13.

  • Laurence, Janice, H. 1997. "Does the Education Credential Still Predict Attrition? In J.M. Arabien (Chair), Everything is New Again: Current Research Issues in Accession Policy." Symposium presented at the 105th Annual Convention of the American Psychological Association, Chicago, Illinois, August 15-17.

  • Muchinsky, Paul M. 2004. "Mechanical Aptitude and Spatial Ability Testing." In Comprehensive Handbook of Psychological Assessment (Vol 4), edited by Jay C. Thomas, 21-34. Hoboken, New Jersey: John Wiley & Sons.

  • National Priorities Project: Bringing the Federal Budget Home. 2010. "Military Recruitment 2010." Accessed May 28. http://nationalpriorities.org/analysis/2011/militaryrecruitment-2010/.

  • Otis, Nancy. 2011. "Relationship between Recruit Quality and Qualification Level 3 Training Performance." Director General Military Personnel Research and Analysis Technical Memorandum 2011-033, Ottawa, Ontario, Canada.

  • Schmidt, Frank L. and John E. Hunter. 1998. "The Validity and Utility of Selection Methods in Personnel Psychology: Practical and Theoretical Implications of 85 Years of Research Findings." Psychological Bulletin 124 (2): 262-274.

  • Shultz, Kenneth S. and David J. Whitney. 2005. Measurement Theory in Action: Case Studies and Exercises. Thousand Oaks, California: Sage Publication, Inc.

  • Skomorovsky, Alla. 2009. "Structured Interview Questionnaire: Examining Convergent and Predictive Validity in a Sample of Privates." Director General Military Personnel Research and Analysis Technical Memorandum 2009-004, Ottawa, Ontario, Canada.


Abstract Views: 264

PDF Views: 2




  • Retention in the Canadian Armed Forces: The Predictive Validity of Three Selection Measures

Abstract Views: 264  |  PDF Views: 2

Authors

Nancy Otis
National Defence, Canada

Abstract


This study examined the predictive validity of the Canadian Forces Aptitude Test (CFAT), educational levels, and the Military Potential (MP) score in predicting retention in the Canadian Armed Forces (CAF). This set of selection measures is fundamental to CAF selection process. The CFAT is a cognitive test that assesses verbal skills, spatial ability, and problem solving ability. The MP score is derived from candidates' performance at a semi-structured interview and their application materials (biographical information, CFAT scores, and educational achievement). The criterion of retention in this research was basic training completion on first attempt. Analyses were performed on data from 14,381 recruits enrolled between fiscal years 04/05 and 08/09. A series of unadjusted logistic regressions were conducted to examine the effects of each measure individually. Then adjusted logistic regressions were conducted to examine the impact of each measure after controlling for the others and for demographic variables (gender and age). All analyses were conducted separately for officers and Non-Commissioned Member (NCM) recruits. Overall, for officer recruits, results from unadjusted logistic regression indicated that high CFAT scores were positively associated with completion of basic training but higher education levels were negatively associated with completion of basic training. However, these relationships did not hold in adjusted logistic regression where only gender and age emerged as significant. For NCM recruits, results of unadjusted logistic regression showed that CFAT scores, and having a high school diploma or higher degree was positively associated with basic training completion and these relationships remained significant in adjusted logistic regression. A positive relation was also found between MP score and basic training completion for NCM recruits, but these relationships were no longer significant in adjusted logistic regression. More studies are needed to fully understand the relative role of all CAF selection measures to the prediction of other retention and performance-related criteria.

Keywords


Retention, Cognitive Test, Interview, Education, Military.

References