There is growing recognition of a need to go beyond levels of automation frameworks to provide more detailed guidance for design of effective human automation interaction (HAI). Here we present some design questions that are important for designers of HAI to address as they develop the requirements for the software architecture and user interfaces for automated aids. This set of guiding questions has grown out of our experience in developing a series of successful collaborative automation systems for airlift planning and scheduling. We illustrate through examples how answers to these high-level questions helped inform the HAI design decisions we confronted. The set of questions are offered in an attempt to broaden the discussion of how best to provide guidance to system developers confronted with HAI design challenges.
References
1.
DePassB.RothE.ScottR.HarterJ.WamplerJ. (2016, September). The Role of Operationally Distinct Options in Supporting Joint Human-Automation Planning. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 60, No. 1, pp. 127-131). SAGE Publications.
2.
DePassB.RothE. M.ScottR.WamplerJ. L.TruxlerR.GuinC.(2011). Designing for collaborative automation: A course of action exploration tool for transportation planning. In Proceedings of the 10th International Conference on Naturalistic Decision Making, May 31-June 3, 2011, Orlando, FL. (pp. 95-100).
3.
Defense Science Board (2012, July). Task force report: The role of autonomy in DoD systems. Washington, DC: Office of the Undersecretary of Defense for Acquisition, Technology and Logistics.
4.
EndsleyM. R. (2018). Level of automation forms a key aspect of autonomy design. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 29-34.
5.
JamiesonG. A. (2018). Levels of automation in human factors models for automation design: Why we might consider throwing the baby out with the bathwater. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 42-49.
6.
JohnsonM.BradshawJ. M.FeltovichP. J. (2018). Tomorrow’s Human-Machine Design Tools: From Levels of Automation to Interdependencies. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 77-82.
7.
KaberD. B. (2018). Issues in Human-Automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and levels of Automation. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 7-24.
8.
LyonsJ. B.KoltaiK. S.HoN. T.JohnsonW. B.SmithD. E.ShivelyR. J. (2016) Engineering trust in complex automated systems, Ergonomics in Design, 13–17.
9.
MillerC. (2018). The Risks of Discretization: What is lost in (Even Good) Levels-of Automation Schemes. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 74-76.
10.
McDermottP. L.WalkerK. E.DominguezC. O.NelsonA. (2017). Slaking the thirst for Human-Machine Teaming Guidance: Helping Systems Acquisition Leverage Cognitive Engineering Research. 13th International Conference on Naturalistic Decision-Making, 2017, Bath UK
11.
RothE. M.DePassB.ScottR.TruxlerR.SmithS.WamplerJ. (2017). Designing collaborative planning systems: Putting Joint Cognitive Systems Principles to Practice. In SmithP. J.HoffmanR. R. (Eds). Cognitive Systems Engineering: The Future for a Changing World. Boca Raton: Taylor & Francis, CRC Press. (247-268).
12.
RothE. M.PritchettA. R. (2018). Preface to the Special Issue on Advancing Models of Human-Automation Interaction. Journal of Cognitive Engineering and Decision Making) 12, 3-6.
13.
WickensC. (2018). Automation stages & levels, 20 years after. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 35-41.
14.
ScottR.RothE. M.DePassB.WamplerJ. (2015). Externalizing planning constraints for more effective joint human-automation planning. In conference proceedings of the 12th international naturalistic decision making conference, held June 9–12, 2015, Mitre Corporation, McLean, Virginia.
15.
ScottR.RothE. M.TruxlerR.OstwaldJ.WamplerJ. (2009) Techniques for effective collaborative automation for air mission replanning. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. (pp. 202-206). Santa Monica, CA: HFES.
16.
SheridanT. B. (2018). Comments in ‘Issues in Human-Automation Interaction Modeling: Presumptive Aspects of frameworks of types and levels of automation’. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction), 12, 25-28.
17.
SmithP. J. (2018). Conceptual frameworks to guide design. Journal of Cognitive Engineering and Decision Making (Special Issue on Advancing Models of Human-Automation Interaction). 12, 50-52
18.
WoodsD. D.HollnagelE. (2006). Joint Cognitive Systems: Patterns in cognitive systems engineering: Boca Raton, FL: Taylor & Francis.
