Decision-Supported Visual Search: Effects of Direct and Indirect Cues on Performance and Attentional Mechanisms

Alberdi E. Povyakalo A. Strigini L. Ayton P. (2004). Effects of incorrect computer-aided detection (CAD) output on human decision-making in mammography. Academic Radiology, 11(8), 909–918. https://doi.org/10.1016/j.acra.2004.05.012

Anderson B. A. Laurent P. A. Yantis S. (2011). Value-driven attentional capture. Proceedings of the National Academy of Sciences, 108(25), 10367–10371. https://doi.org/10.1073/pnas.1104047108

Bartlett M. L. McCarley J. S. (2017). Benchmarking aided decision making in a signal detection task. Human Factors, 59(6), 881–900. https://doi.org/10.1177/0018720817700258

Bartlett M. L. McCarley J. S. (2019). No effect of cue format on automation dependence in an aided signal detection task. Human Factors, 61(2), 169–190. https://doi.org/10.1177/0018720818802961

Blanca M. J. Alarcón R. Arnau J. Bono R. Bendayan R. (2018). Effect of variance ratio on ANOVA robustness: Might 1.5 be the limit? Behavior Research Methods, 50(3), 937–962. https://doi.org/10.3758/s13428-017-0918-2

Bolton M. L. (2022). Trust is not a virtue: Why we should not trust trust. Ergonomics in Design: The Quarterly of Human Factors Applications, 32(4), 4–11. https://doi.org/10.1177/10648046221130171

Boskemper M. M. Bartlett M. L. McCarley J. S. (2022). Measuring the efficiency of automation-aided performance in a simulated baggage screening task. Human Factors, 64(6), 945–961. https://doi.org/10.1177/0018720820983632

Bricolo E. Gianesini T. Fanini A. Bundesen C. Chelazzi L. (2002). Serial attention mechanisms in visual search: A direct behavioral demonstration. Journal of Cognitive Neuroscience, 14(7), 980–993. https://doi.org/10.1162/089892902320474454

Brockmole J. R. Henderson J. M. (2006). Using real-world scenes as contextual cues for search. Visual Cognition, 13(1), 99–108. https://doi.org/10.1080/13506280500165188

Burgess A. E. Jacobson F. L. Judy P. F. (2001). Human observer detection experiments with mammograms and power-law noise. Medical Physics, 28(4), 419–437. https://doi.org/10.1118/1.1355308

Buser D. Sterchi Y. Schwaninger A. (2020). Why stop after 20 minutes? Breaks and target prevalence in a 60-minute x-ray baggage screening task. International Journal of Industrial Ergonomics, 76, 102897. https://doi.org/10.1016/j.ergon.2019.102897

Chavaillaz A. Schwaninger A. Michel S. Sauer J. (2018). Automation in visual inspection tasks: X-ray luggage screening supported by a system of direct, indirect or adaptable cueing with low and high system reliability. Ergonomics, 61(10), 1–14. https://doi.org/10.1080/00140139.2018.1481231

Chun M. M. Jiang Y. (1998). Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognitive Psychology, 36(1), 28–71. https://doi.org/10.1006/cogp.1998.0681

Cunningham C. A. Drew T. Wolfe J. M. (2016). Analog computer-aided detection (CAD) information can be more effective than binary marks. Attention, Perception, & Psychophysics, 79(2), 679–690. https://doi.org/10.3758/s13414-016-1250-0

Donk M. van Zoest W. (2008). Effects of salience are short-lived. Psychological Science, 19(7), 733–739. https://doi.org/10.1111/j.1467-9280.2008.02149.x

Drew T. Cunningham C. Wolfe J. M. (2012). When and why might a computer-aided detection (CAD) system interfere with visual search? An eye-tracking study. Academic Radiology, 19(10), 1260–1267. https://doi.org/10.1016/j.acra.2012.05.013

Faul F. Erdfelder E. Lang A.-G. Buchner A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146

Fok R. Weld D. S. (2024). In search of verifiability: Explanations rarely enable complementary performance in ai-advised decision making. AI Magazine, 45(3), 317–332. https://doi.org/10.1002/aaai.12182

Gandomkar Z. Mello-Thoms C. (2019). Visual search in breast imaging. The British Journal of Radiology, 92(1102), 20190057. https://doi.org/10.1259/bjr.20190057

Gaube S. Jussupow E. Kokje E. Khan J. Bondi-Kelly E. Schicho A. Kitamura F. C. Koch T. K. Ezer T. Mottok J. Lermer E. Ghassemi M. Colak E. (2024). Underreliance harms human-ai collaboration more than overreliance in medical imaging. https://doi.org/10.31219/osf.io/4wv8j

Glass G. V. Peckham P. D. Sanders J. R. (1972). Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance. Review of Educational Research, 42(3), 237–288. https://doi.org/10.3102/00346543042003237

Goh J. Wiegmann D. A. Madhavan P. (2005). Effects of automation failure in a luggage screening task: A comparison between direct and indirect cueing. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3), 492–496. https://doi.org/10.1177/154193120504900359

Green D. M. Swets J. A. (1966). Signal detection theory and psychophysics: Wiley.

Grippenkoven J. Rodd J. Brandenburger N. (2018). DLR-WAT: Ein Instrument zur Untersuchung des optimalen Beanspruchungsniveaus in hochautomatisierten Mensch-Maschine-Systemen. AAET Automatisiertes & Vernetztes Fahren, 199–213. https://elib.dlr.de/119443/

Hautus M. J. (1995). Corrections for extreme proportions and their biasing effects on estimated values of d. Behavior Research Methods, Instruments, & Computers, 27(1), 46–51. https://doi.org/10.3758/bf03203619

Huegli D. Chavaillaz A. Sauer J. Schwaninger A. (2025). Effects of false alarms and miscues of decision support systems on human–machine system performance: A study with airport security screeners. Ergonomics, 68(12), 1–16. https://doi.org/10.1080/00140139.2025.2453546

Huegli D. Merks S. Schwaninger A. (2020). Automation reliability, human–machine system performance, and operator compliance: A study with airport security screeners supported by automated explosives detection systems for cabin baggage screening. Applied Ergonomics, 86, 103094. https://doi.org/10.1016/j.apergo.2020.103094

Kelley B. Wickens C. Warden A. C. Clegg B. Ortega F. (2024). 2d and 3d augmented reality attention cueing comparisons in 3d target search. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 68(1), 1176–1180. https://doi.org/10.1177/10711813241265077

Kinchla R. A. Chen Z. Evert D. (1995). Precue effects in visual search: Data or resource limited? Perception & Psychophysics, 57(4), 441–450. https://doi.org/10.3758/bf03213070

Leonard C. J. Egeth H. E. (2008). Attentional guidance in singleton search: An examination of top-down, bottom-up, and intertrial factors. Visual Cognition, 16(8), 1078–1091. https://doi.org/10.1080/13506280701580698

Li J. Zhou L. Zhan Y. Xu H. Zhang C. Shan F. Liu L. (2022). How does the artificial intelligence-based image-assisted technique help physicians in diagnosis of pulmonary adenocarcinoma? A randomized controlled experiment of multicenter physicians in China. Journal of the American Medical Informatics Association, 29(12), 2041–2049. https://doi.org/10.1093/jamia/ocac179

Macmillan N. A. Creelman C. D. (2004). Detection theory – A user’s guide. Psychology Press. https://doi.org/10.4324/9781410611147

McKinney S. M. Sieniek M. Godbole V. Godwin J. Antropova N. Ashrafian H. Back T. Chesus M. Corrado G. S. Darzi A. Etemadi M. Garcia-Vicente F. Gilbert F. J. Halling-Brown M. Hassabis D. Jansen S. Karthikesalingam A. Kelly C. J. King D. Shetty S. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577(7788), 89–94. https://doi.org/10.1038/s41586-019-1799-6

Morey R. D. (2008). Confidence intervals from normalized data: A correction to cousineau (2005). Tutorials in Quantitative Methods for Psychology, 4(2), 61–64. https://doi.org/10.20982/tqmp.04.2.p061

Mosier K. L. Manzey D. (2020). Humans and automated decision aids: A match made in heaven? In Mouloua M. Hancock P. A. (Eds.), Human performance in automated and autonomous systems: Current theory and methods (pp. 19–42): CRC Press.

Nakayama K. Mackeben M. (1989). Sustained and transient components of focal visual attention. Vision Research, 29(11), 1631–1647. https://doi.org/10.1016/0042-6989(89)90144-2

Onnasch L. Roesler E. Robert L. P. De Visser E. (2026). Trust(worthiness) issues with trust in human–robot interaction. ACM Transactions on Human-Robot Interaction, 15(3), 1–19. https://doi.org/10.1145/3778865

Pashler H. (1987). Detecting conjunctions of color and form: Reassessing the serial search hypothesis. Perception & Psychophysics, 41(3), 191–201. https://doi.org/10.3758/bf03208218

Patton C. E. Wickens C. D. (2024). The relationship of trust and dependence. Ergonomics, 67(11), 1535–1552. https://doi.org/10.1080/00140139.2024.2342436

Peirce J. Gray J. R. Simpson S. MacAskill M. Höchenberger R. Sogo H. Kastman E. Lindeløv J. K. (2019). Psychopy2: Experiments in behavior made easy. Behavior Research Methods, 51(1), 195–203. https://doi.org/10.3758/s13428-018-01193-y

Raikwar A. Mifsud D. Wickens C. D. Batmaz A. U. Warden A. C. Kelley B. Clegg B. A. Ortega F. R. (2024). Beyond the wizard of oz: Negative effects of imperfect machine learning to examine the impact of reliability of augmented reality cues on visual search performance. IEEE Transactions on Visualization and Computer Graphics, 30(5), 1–9. https://doi.org/10.1109/tvcg.2024.3372062

Rieger T. Heilmann L. Manzey D. (2021). Visual search behavior and performance in luggage screening: Effects of time pressure, automation aid, and target expectancy. Cognitive Research: Principles and Implications, 6(12), 1–12. https://doi.org/10.1186/s41235-021-00280-7

Rieger T. Manzey D. (2022). Human performance consequences of automated decision aids: The impact of time pressure. Human Factors, 64(4), 617–634. https://doi.org/10.1177/0018720820965019

Rieger T. Manzey D. (2024). Understanding the impact of time pressure and automation support in a visual search task. Human Factors, 66(3), 770–786. https://doi.org/10.1177/00187208221111236

Rieger T. Marx B. Manzey D. (2025). Likelihood systems can improve hit rates in low-prevalence visual search over binary systems. Human Factors, 67(9), 861–876. https://doi.org/10.1177/00187208251320589

Rieger T. Onnasch L. Roesler E. Manzey D. (2025). Why highly reliable decision support systems often lead to suboptimal performance and what we can do about it. IEEE Transactions on Human-Machine Systems, 55(5), 736–745. https://doi.org/10.1109/THMS.2025.3584662

Schwarz W. Miller J. (2016). GSDT: An integrative model of visual search. Journal of Experimental Psychology: Human Perception and Performance, 42(10), 1654–1675. https://doi.org/10.1037/xhp0000247

Sha L. Z. Remington R. W. Jiang Y. V. (2018). Statistical learning of anomalous regions in complex faux x-ray images does not transfer between detection and discrimination. Cognitive Research: Principles and Implications, 3(1), 1–16. https://doi.org/10.1186/s41235-018-0144-1

Treisman A. M. Gelade G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12(1), 97–136. https://doi.org/10.1016/0010-0285(80)90005-5

Vaccaro M. Almaatouq A. Malone T. (2024). When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behaviour, 8(12), 2293–2303. https://doi.org/10.1038/s41562-024-02024-1

van Renswoude D. R. Raijmakers M. E. J. Koornneef A. Johnson S. P. Hunnius S. Visser I. (2017). Gazepath: An eye-tracking analysis tool that accounts for individual differences and data quality. Behavior Research Methods, 50(2), 834–852. https://doi.org/10.3758/s13428-017-0909-3

van Zandt T. Townsend J. T. (1993). Self-terminating versus exhaustive processes in rapid visual and memory search: An evaluative review. Perception & Psychophysics, 53(5), 563–580. https://doi.org/10.3758/bf03205204

Vasconcelos H. Jörke M. Grunde-McLaughlin M. Gerstenberg T. Bernstein M. S. Krishna R. (2023). Explanations can reduce overreliance on ai systems during decision-making. Proceedings of the ACM on Human-Computer Interaction, 7(CSCW1), 1–38. https://doi.org/10.1145/3579605

Võ M. L.-H. Boettcher S. E. Draschkow D. (2019). Reading scenes: How scene grammar guides attention and aids perception in real-world environments. Current Opinion in Psychology, 29, 205–210. https://doi.org/10.1016/j.copsyc.2019.03.009

Vukadinovic D. Anderson D. (2022). X-ray baggage screening and artificial intelligence (ai): A technical review of machine learning techniques for x ray baggage screening. Publications Office of the European Union. https://doi.org/10.2760/46363

Wiczorek R. Manzey D. (2014). Supporting attention allocation in multitask environments: Effects of likelihood alarm systems on trust, behavior, and performance. Human Factors, 56(7), 1209–1221. https://doi.org/10.1177/0018720814528534

Wolfe J. M. (2021). Guided search 6.0: An updated model of visual search. Psychonomic Bulletin & Review, 28(4), 1060–1092. https://doi.org/10.3758/s13423-020-01859-9

Wolfe J. M. Alaoui Soce A. Schill H. M. (2017). How did i miss that? Developing mixed hybrid visual search as a ‘model system’ for incidental finding errors in radiology. Cognitive Research: Principles and Implications, 2(1), 35. https://doi.org/10.1186/s41235-017-0072-5

Zhao Z. Wang S. Gu J. Zhu Y. Mei L. Zhuang Z. Cui Z. Wang Q. Shen D. (2024). Chatcad+: Toward a universal and reliable interactive cad using llms. IEEE Transactions on Medical Imaging, 43(11), 3755–3766. https://doi.org/10.1109/tmi.2024.3398350