Multi-Factor Evaluation of Tactical Planning Aids

Multiple measures of tactical-planning performance were employed to evaluate prototype computer-based planning aids. The objectives of the evaluation were to: 1) assess the extent of overall performance improvement, if any, over existing manual methods, 2) diagnose the impact of computer-aiding on each of the different components of planning performance, and 3) Identify potential deficiencies and needed improvements in specific computer-based aids. The evaluation approach was based on the decomposition of planning into specific components and the measurement of each component within a specific mission context. Within a latin-square experimental design, eight tank platoon leaders first used present paper-map methods to solve tactical problems and then used a system of computer aiding to solve comparable but different problems. Seven objective performance measures assessed different components of planning performance under map and aided conditions; an objective measure of overall mission success and subjective assessments of individual planning aids were also obtained. Results provided a multi-dimensional basis for assessing the potential value of computer-based aids and for further enhancement of the planning aids. Overall, use of the prototype planning aids resulted in a significantly greater rate of mission success, 94 percent vs. 44 percent.