Assessment of Nontechnical Skills: From Measurement to Categorization Modeled by Fuzzy Logic
Abstract
The assessment of pilots' performances and more specifically their nontechnical skills turns out to be difficult because researchers and practitioners find that inter-rater reliability tends to be moderate to low. In this study, we proposed, consistent with field observations, that assessment is a categorization rather than a measurement issue. Categorization, even though, and especially when, based on imprecise information and assessments, can be modeled mathematically using fuzzy logic. We present the structure of the approach and provide an example from a large database of pilots providing reasons for their assessments ...
View more >The assessment of pilots' performances and more specifically their nontechnical skills turns out to be difficult because researchers and practitioners find that inter-rater reliability tends to be moderate to low. In this study, we proposed, consistent with field observations, that assessment is a categorization rather than a measurement issue. Categorization, even though, and especially when, based on imprecise information and assessments, can be modeled mathematically using fuzzy logic. We present the structure of the approach and provide an example from a large database of pilots providing reasons for their assessments of other pilots' (simulator) flying performances. Considering the implications, we discuss possibilities for using the variations in performance ratings positively, as a source for learning and resilience building.
View less >
View more >The assessment of pilots' performances and more specifically their nontechnical skills turns out to be difficult because researchers and practitioners find that inter-rater reliability tends to be moderate to low. In this study, we proposed, consistent with field observations, that assessment is a categorization rather than a measurement issue. Categorization, even though, and especially when, based on imprecise information and assessments, can be modeled mathematically using fuzzy logic. We present the structure of the approach and provide an example from a large database of pilots providing reasons for their assessments of other pilots' (simulator) flying performances. Considering the implications, we discuss possibilities for using the variations in performance ratings positively, as a source for learning and resilience building.
View less >
Journal Title
Aviation Psychology and Applied Human Factors
Volume
3
Issue
2
Copyright Statement
© 2013 Hogrefe Publishing. This is an electronic version of an article published in Aviation Psychology and Applied Human Factors, Volume 3, Issue 2, Pages 73-82, 2013 by Hogrefe Publishing. This article may not exactly replicate the final version published in Aviation Psychology and Applied Human Factors. It is not the version of record and is therefore not suitable for citation.
Subject
Technical, Further and Workplace Education
Education Assessment and Evaluation
Vocational Education and Training Curriculum and Pedagogy
Transportation and Freight Services
Psychology
Cognitive Sciences