Behavior Analysis in Practice Humanities and social sciences
The Relative Effectiveness of Operational Versus Pinpoint-Style Definitions on Detection Accuracy: An Extension Across Four Challenging Behavior Topographies
Abstract
The effectiveness of any behavioral intervention depends on the quality of the data used to make treatment decisions. This study compared the relative effects of operational versus pinpoint-style definitions on school-based staff detection accuracy. Using an alternating treatments design, four professionals who report on behavior as part of their job duties at a high school collected data on four topographies of challenging behavior from role-play videos under two conditions that differed only in the descriptor of the target behavior: operational definitions, promoted as best practice in applied behavior analysis, and pinpoint-style (abbreviated) definitions that use action verbs and objects receiving the action. Detection accuracy, specifically whether observers correctly identified instances of the target behavior, was compared across conditions. Pinpoint-style definitions yielded higher mean detection accuracy than operational definitions for three of four participants, with an overall difference of 5.63 percentage points; accuracy favored the pinpoint-style condition at 9 of 16 comparison points, favored the operational definition at 1, and was equal at the remaining 6. Within-participant comparisons across repeated video observations, however, showed clear differentiation between conditions for only one participant. Although most participants were more accurate under the pinpoint-style condition, all reported preferring operational definitions during the social validity assessment, a finding that may reflect their familiarity with operational definitions and the fact that they did not see their accuracy results before rating their preferences.