Applying Quality Control Charts to the Analysis of Single-Subject Data Sequences

Abstract

Techniques from the field of quality control can be used to classify the quality of individual samples of physical or cognitive performance. After stable baselines have been established for an individual, deviations in performance can be evaluated using control charts. The effectiveness of this approach in evaluating cognitive performance was tested using databases collected under a variety of risk factors. The sensitivity and specificity characteristics of Shewhart, cumulativesum (CUSUM), and exponentially weighted moving average (EWMA) control charts were determined for a total of 174 trials involving 10 participants and 23 cognitive performance assessment measures. The most effective technique in each case was typically a function of the specific performance measure and the type of performance change being evaluated. Sensitivity and specificity for the best techniques were as high as 100%. This study demonstrated the usefulness of quality control charts as a tool to evaluate individual participant performance over time. Actual or potential applications of this research include readiness-to-perform screening of industrial workers in order to improve the health and safety of the workforce.