Test and Evaluation of an Air Force Non-Developmental Item (NDI) Computer System

The Air Force is fielding a computer-based command and control system to support fighter base mission requirements. The acquisition strategy for this system was to purchase it as a Non-Developmental Item (NDI). Since the hardware and software were in the Air Force inventory, it was determined that system development was not necessary. Initial implementation and installation occurred without system-level specifications or performance requirements. This paper presents the results of a Human Factors Engineering evaluation of the system from three perspectives: an Expert's view, a Military Standard view, and a User's view. Two primary lessons resulted from the evaluation: First, the multi-perspective evaluation technique is valuable and highly recommended for use in other HFE evluations. Second, the purchase of NDI or commercial off-the-shelf (COTS) items should be viewed from the systems perspective, i.e., even though subsystems may be NDI, the system may be developmental.