Evaluation of Complex Human-Machine Systems Using HFE Guidelines

Abstract

The purpose of this paper is to discuss the role of human factors engineering (HFE) guidelines in the evaluation of complex human-machine systems, such as advanced nuclear power plants. Advanced control rooms will utilize human-system interface (HSI) technologies that can have significant implications for plant safety in that they will affect the ways in which plant personnel interact with the system. In order to protect public health and safety, the U.S. Nuclear Regulatory Commission reviews the HFE aspects of plant HSIs to ensure that they are designed to HFE principles and that operator performance and reliability are appropriately supported. Evaluations using HFE guidelines are an important part of the overall review methodology. The Advanced HSI Design Review Guideline (DRG) was developed to provide these review criteria. This paper will address (1) the issues associated with guideline-based evaluations, (2) DRG development and validation, and (3) the DRG review procedures.

Get full access to this article

View all access options for this article.

References

Flach

(1990). “The Ecology of Human-Machine Systems I: Introduction.” Ecological Psychology, 2, 191–205.

Karat

(1989). “The Relation of Psychological Theory to Human-Computer Interaction Standards.” In Salvendy

Smith

(eds.), Designing and Using Human-Computer Interfaces and Knowledge Based Systems. Amsterdam, Netherlands: Elsevier Science Publishers.

Mosier

Smith

(1985). “Application of Guidelines for Designing User Interface Software.” In Proceedings of the Human Factors Society–29th Annual Meeting, Santa Monica, CA: Human Factors Society.

O'Hara

Higgins

Stubler

(1994a). Human factors engineering program review model. Upton, New York: Brookhaven National Laboratory.

O'Hara

Brown

Baker

Welch

Granda

Vingelis

(1994b). Advanced Human System Interface Design Review Guideline (NUREG/CR-5908). Upton, New York: Brookhaven National Laboratory.

O'Hara

Hall

(1990). “Human-Computer Interface and Human Reliability.” In Proceedings on Advances in Human Factors Research on Man/Computer Interactions, Nashville, TN: American Nuclear Society, 339–345.

Potter

(1990). “The Role of Human Factors Guidelines in Designing Usable Systems: A Case Study of Operating Room Equipment.” In Proceedings of the Human Factors Society - 34th Annual Meeting, Santa Monica, CA: Human Factors Society.

Ravden

Johnson

(1989). Evaluating usability of human-computer interfaces: A practical method. Chichester, England: Ellis Horwood Limited.

Reaux

Williges

(1988). “Effects of Level of Abstraction and Presentation Media on Usability of User-System Interface Guidelines.” In Proceedings of the Human Factors Society - 32nd Annual Meeting, Santa Monica, CA: Human Factors Society.

10.

Shneiderman

(1987). Designing the user interface: Strategies for effective human-computer interaction. Reading, MA: Addison-Wesley.

11.

Smith

(1988). “Standards Versus Guidelines for Designing User Interface Software.” In Helender

(ed.) Handbook of Human-Computer Interaction, Amsterdam: Elsevier Science Publishers.

12.

Smith

Mosier

(1986). Guidelines for designing user interface software (Department of Defense ESD-TR-86-278). Washington, D.C.: Office of Management and Budget.

13.

U.S. Nuclear Regulatory Commission (1981). Guidelines for control room design reviews (NUREG 0700). Washington, D.C.: U.S. Government Printing Office.

14.

Vincente

Rasmussen

(1990). “The ecology of human-machine systems II: Mediating “direct perception” in complex work domains.” Ecological Psychology, 2, 207–249.

15.

Woods

Roth

Stubler

Mumaw

(1990). “Navigating through Large Display Networks in Dynamic Control Applications.” In Proceedings of the Human Factors Society - 34th Annual Meeting, Santa Monica, CA: Human Factors Society.

16.

Woods

Johannesen

Potter

(1992). “The Sophistry of guidelines: Revisiting recipes for color use in human-computer interaction.” In Proceedings of the Human Factors Society - 36th Annual Meeting, Santa Monica, CA: Human Factors Society.