An Eye-tracking Study of The Cross-Modal Influence of Musical Stimuli on Visual Attention
Abstract
switching speed of attention are core factors that determine task performance and safety levels. As a common acoustic stimulus, music has
extensive and enduring effects on attentional processes. This study adopted eye-tracking technology to explore the influence of different music
types on attention. Three types of music with the same melody were selected: the music with lyric, the music without lyric, the reverberant
music with lyric. Visual search tasks were used to measure participants' attentional focus under different musical conditions. Three groups of
participants completed four sets of high-difficulty visual search tasks and four sets of low-difficulty visual search tasks under one of the three
auditory backgrounds. Post-experiment data analysis indicated no significant difference in performance among the three groups in the highdifficulty tasks. However, in the low-difficulty tasks, the reverberant music group showed significantly higher Total Fixation Duration, Fixation Counts, and Time to First Fixation. This reveals the reverberant group had longer task completion time compared to the other two groups.
The eye-tracking technology could record high-precision physiological activities which is free from motor contamination. By leveraging eyetracking technology this study overcomes the limitation of traditional reaction time research, where cognitive processing and motor execution
are conflated. It provides a new chain of evidence for cognitive load theory with clearer stages, purer data, and higher precision. Furthermore,
the findings extend the classic "low-load processing - high-load shielding" hypothesis to the auditory-visual cross-modal ecological scenarios.
Additionally, the study reveals that the reverberation sound effect has negative impact on visual search efficiency. Hence, this sound effect
should be used cautiously in scenarios requiring high levels of attention. This research also establishes safety boundaries for the design of auditory environments in situations, such as learning and driving.
Keywords
Full Text:
PDFReferences
[1] Arnsten, A. F. (2009). Stress signalling pathways that impair prefrontal cortex structure and function. Nature Reviews Neuroscience,
10(6), 410422.
[2] ATSB. (2015). Safety survey report. SKYbrary Aviation Safety.
[3] Beilock, S. L., & Carr, T. H. (2001). On the fragility of skilled performance: What governs choking under pressure? Journal of Experimental Psychology: General, 130(4), 701725.
[4] Bigand, E., & Poulin-Charronnat, B. (2006). Are we "experienced listeners"? A review of the musical capacities that do not depend on
formal musical training. Cognition, 100(1), 100130.
[5] Blauert, J. (1997). Spatial Hearing: The Psychophysics of Human Sound Localization (2nd ed.). MIT Press.
[6] Civil Aviation Authority. (2021). Flight-crew human factors handbook (CAP 737).
[7] Coutrot, A., Guyader, N., Ionescu, G., & Caplier, A. (2012). Influence of soundtrack on eye movements during video exploration. Journal of Eye Movement Research, 5 (4), 110.
[8] Cutler, A. (2012). Native listening: Language experience and the recognition of spoken words. MIT Press.
[9] Doyle, M., & Furnham, A. (2012). The distracting effects of music on reading comprehension: A meta-analysis. Psychology of Music,
40(4), 549565.
[10] FAA. (2000). Analysis of ATC operational errors 19972000. U.S. Department of Transportation.
[11] Fredrickson, B. L. (2001). The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions.
American Psychologist, 56(3), 218226.
[12] Gonzalez M F, Aiello J R. More than meets the ear: Investigating how music affects cognitive task performance[J]. Journal of Experimental Psychology: Applied, 2019, 25(3): 431.
[13] Hallam, S., Price, J., & Katsarou, G. (2002). The effects of background music on primary school pupils' task performance. Educational
Studies, 28(2), 111122.
[14] Hartl, P., & Hartlov, J. (2015). P?ehled psychologie (Overview of Psychology). Prague: Academia.
[15] Kiss, L., & Linnell, K. J. (2024). Fast tempo increases mind-wandering: Evidence from a sustained attention task. Journal of Experimental Psychology: Human Perception and Performance, 50(3), 213225.
[16] Mark, G., Gudith, D., & Klocke, U. (2008). The Cost of Interrupted Work: More Speed and Stress.
[17] Ministry of Public Security, Road Traffic Safety Research Center. (2024).2023 Annual Report on Road Traffic Accident Statistics. Ministry of Public Security of the People's Republic of China.
[18] Owen, L., & Sunram-Lea, S. I. (2011). Metabolic agents that enhance ATP can improve cognitive functioning: A review of the evidence
for glucose, oxygen, pyruvate, creatine, and L-carnitine. Nutrients, 3(8), 735755.
[19] Ralph, B. C., et al. (2014). Media multitasking and memory differences in working and long-term memory. Psychonomic Bulletin & Review, 21(2), 452-458.
[20] Sailer, P., & McCulloh, I. (2012). Social networks and spatial configurationHow office layouts drive social interaction. Social Networks, 34(1), 4758.
[21] Srqvist, P., & Marsh, J. E. (2015). How concentration shields against distraction: Cognitive load and the irrelevance-of-perception hy-
pothesis. In P. Srqvist (Ed.), Auditory distraction and order: Theoretical and applied perspectives (pp. 122). Psychology Press.
[22] Spence, C., & Driver, J. (2000). Atmospheric environmental psychology: Sound and vision in synergy. Current Biology, 10(10), R372
R373.
[23] Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257285.
[24] Sweller, J., van Merrinboer, J. J., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261292.
[25] Webb, T. L., Gallo, D. A., & Simons, D. J. (2016). What attention is and is not. Trends in Cognitive Sciences, 20(10), 742-753.
[26] World Health Organization. (2018). Global status report on road safety 2018. Geneva: WHO Press.
[27] Yang, Y., & Yu, C. (2023). Effects of background music volume and tempo on visual search performance. Journal of Cognitive Psychology, 35(4), 421433.
DOI: http://dx.doi.org/10.70711/rcha.v4i1.8896
Refbacks
- There are currently no refbacks.