Menu Design Based on Expert Knowledge Structures: A Validation

Abstract

This project evaluated the effectiveness gained by redesigning a user interface based on the knowledge structure of domain experts. Scenario-based simulation enables realistic training in synthetic environments. As the instructor remains essential to facilitating effective scenario-based training, their user interface should be efficient. Previous research modeled knowledge structures used to redesign a menu within a scenario generation interface. The current research evaluated the redesigned menu based on the ascertained knowledge structures. To evaluate the redesigned menu, participants were timed as they selected target items in the original and redesigned menus. Results indicated that experienced users selected items in the redesigned menu significantly faster, and preferred the redesigned menu to the original. Thus, this result demonstrates tangible benefits to organizing menus according to expert knowledge, even when users are familiar with a menu structure. Using methods that follow the general principles presented here will enable designers to uncover expert knowledge and efficiently configure user interfaces, thereby improving training effectiveness.

Get full access to this article

View all access options for this article.

References

Andrews

Bell

(2000). Simulation-based training. In Tobias

Fletcher

(Eds.), Training & retraining: A handbook for business, industry, government, and the military (pp. 357–384). New York: American Psychological Society.

Andrews

Bell

(2009). A virtual environment application: Distributed Mission Operations. In Cohn

Nicholson

Schmorrow

(Eds.), Virtual Environments for Training and Education: Developments for the Military and Beyond (pp. 77–84). Westport, CT: Praeger Security International.

Bell

Waag

(1998). Evaluating the effectiveness of flight simulators for training combat skills: A review. International Journal of Aviation Psychology, 8, 223–242.

Covas-Smith

C. M.

Jackson

K. D.

Branaghan

R. J.

Eidman

(2010). Eliciting and Representing Knowledge Structures of Expert Pilots: Guidance for Menu Design. Manuscript in preparation.

Cyril

Jaar

St-Pierre

(2000). Advanced space robotics simulation for training and operations. Paper presented at the AIAA Modeling and Simulation Technologies Conference.

Eidman

Crane

Kam

Gehr

S. E.

Zamba

(2007). Exercise pacific link 2: Distributed training for air battle managers. Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), (7104), 1–12.

Fisher

Laurie

Glaser

(2002). Use of a fixed base driving simulator to evaluate the effects of experience and PC-based risk assessment training on drivers' decisions. Human Factors, 44 (2), 287–302.

Fowlkes

Dwyer

Oser

Salas

(1998). Event-based approach to training (EBAT). International Journal of Aviation Psychology, 8 (3), 209–221.

Gentner

Stevens

(1983). Mental models. Hillsdale, NJ: Erlbaum.

10.

Harris

Kahn

(2003). Response time to reject a takeoff. Human Factors and Aerospace Safety, 3, 165–175.

11.

Hayhoe

(1990). Sorting-based menu categories. International Journal of Man-Machine Studies, 33, 677–705.

12.

Inquisit. (2006). Inquisit 2.0.60616. Seattle, WA: Millisecond Software.

13.

Johnson-Laird

P. N.

(1983). Mental Models. Cambridge, MA: Harvard University Press.

14.

McDonald

Dayton

McDonald

(1988). Adapting menu layout to tasks. International Journal of Man-Machine Studies, 28, 417–436.

15.

McDonald

Schvaneveldt

R. W.

(1988). The application of user knowledge to interface design. In Guindon

(Ed.), Cognitive Science and its Application for Human Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum & Associates.

16.

McDonald

Stone

Liebelt

(1983). Searching for items in menus: The effects of organization and type of target. Paper presented at the Human Factors Society, Norflok, VA.

17.

Norman

D. A.

(1986). Cognitive engineering. In Norman

D. A.

Draper

S.W.

(Eds.), User-centered system design: New perspectives in human-computer interaction (pp. 31–61). Hillsdale, NJ: Erlbaum.

18.

Norman

D. A.

(1988). The Psychology of Everyday Things. New York: Harper-Row.

19.

Paap

K. R.

Cooke

N. J.

(1997). Design of menus. In Helander

Landauer

T. K.

Prabhu

(Eds.), Handbook of Human Computer Interaction. Amsterdam: Elsevier Press.

20.

Park

Rochlen

Yaghmour

Higgins

Bauchat

Wojciechowski

(2010). Acquisition of Critical Intraoperative Event Management Skills in Novice Anesthesiology Residents by Using High-fidelity Simulation-based Training. Anesthesiology, 112 (1), 202–211.

21.

Ramesh

Sylla

(1990). A framework for the optimal design of instructor / operator stations in flight simulators. IEEE Transactions on Systems, Man, and Cybernetics, 20 (3), 571–581.

22.

Roske-Hofstrand

R. J.

Paap

K. R.

(1986). Cognitive networks as a guide to menu organization: An application in the automated cockpit. Ergonomics, 39, 1301–1311.

23.

Salas

Wilson

Priest

Guthrie

(2006). Design, delivery, and evaluation of training systems. In Salvendy

(Ed.), Handbook of Human Factors and Ergonomics (3 ed., pp. 472–512). Hoboken, NJ: Wiley.

24.

Schwid

Rooke

Carline

Steadman

Murray

Olympio

(2002). Evaluation of anesthesia residents using mannequin-based simulation - A multiinstitutional study. Anesthesiology, 97 (6), 1434–1444.

25.

Tannenbaum

Yuki

(1992). Training and development in work organizations. Annual Review of Psychology, 43, 399–441.

26.

Wickens

Carswell

(1995). The proximity compatibility principle: Its psychological foundations and relevance to display design. Human Factors, 37, 473–494.

27.

Wickens

Helleberg

(2002). Pilot maneuver choice and workload in free flight. Human Factors, 44 (2), 171–188.