Kevin Munhall, PhD
Principle Investigator
Research Interests: Conversation is one of our most common and highly skilled activities. When we talk with other people, we perceive and produce a remarkable amount of social, emotional and linguistic information. This information is conveyed visually through the movements of our face and body and acoustically through our voice. In my laboratory, we study the perceptual and cognitive activities that make conversation possible. We use a variety of experimental techniques such as eye tracking, motion capture, animation and psychophysics to explore the multisensory processes and brain structures that are involved in face-to-face communication.
Selected Publications
Latif, N., Alsius, A., & Munhall, K.G. (2018). Knowing when to respond: the role of visual information in conversational turn exchanges. Attention, Perception & Psychophysics, 80, 27-41.
Alsius, A., Paré, M., & Munhall, K.G. (2018). Forty Years After Hearing Lips and Seeing Voices the McGurk Effect Revisited. Multisensory Research, 31, 111-144.
Mitsuya, T., Munhall, K.G., & Purcell, D.W. (2017). Modulation of auditory-motor learning in response to formant perturbation as a function of delayed auditory feedback. J. Acoust. Soc. Am. 141, 2758-2767.
Wilson, A., Alsius, A., Paré, M., & Munhall, K.G. (2016). Spatial frequency requirements and gaze strategy in visual-only and audiovisual speech perception. Journal of Speech, Hearing and Language Research, 59, 601-615.
Latif, N., Barbosa, A.V., Vatikiotis-Bateson, E., Castelhano, M.S. and Munhall, K.G. (2014). Movement coordination during conversation. PloS One, 9(8), e105036.
MacDonald, E.N., Johnson, E.K., Forsythe, J., Plante, P., Munhall, K.G. (2012). Children’s development of self-regulation in speech production. Current Biology, 24:22(2), 113-7.
Agnes Alsius, Post-Doctoral Fellow
Speech Perception and Production Laboratory
Department of Psychology
Queen's University
Area of research: Audiovisual speech perception; Speechreading; Crossmodal integration; Sensory feedback and motor control of speech production
Education
Ph.D. Cognitive science and language program, Psychology, University of Barcelona, 2009
B.A. Psychology, University of Barcelona, 2003
Publications
Wilson, A., Alsius, A., Paré, M., & Munhall, K.G. (2016). Spatial frequency requirements and gaze strategy in visual-only and audiovisual speech perception. Journal of Speech, Hearing and Language Research, 59, 601-615.
Alsius, A., Wayne, R., Paré, M., & Munhall, K.G. (2016). High Visual Resolution Matters in Audiovisual Speech Perception, But Only for Some. Attention, Perception & Psychophysics, 78, 1472-1487
Jaekl, P., Pesquita, A., Alsius, A., Munhall, K., & Soto-Faraco, S. (2015). The contribution of dynamic visual cues to audiovisual speech perception. Neuropsychologia, 75, 402-410.
Alsius, A., Möttönen, R., Sams, M.E., Soto-Faraco, S., & Tiippana, K. (2014). Effect of attentional load on audiovisual speech perception: evidence from ERPs. Frontiers in Psychology, 5, 727.
Barrós-Lorcertales, A., Ventura-Campos, N., Visser, M., Alsius, A., Pallier, C., Ávila, C. & Soto-Faraco, S. (2013). The neural correlates of audiovisual speech processing in second language. Brain and Language, 126(3), 253-262.
Alsius, A. & Munhall, K. (2013). Detection of audiovisual speech correspondences without visual awareness. Psychological Science, 24, 423-431.
Sánchez-García, C., Alsius, A., Enns, J. & Soto-Faraco, S. (2011). Cross-modal prediction in speech perception. PLoS ONE, (10):e25198.
Alsius, A. & Soto-Faraco, S. (2011) Searching for audiovisual correspondence in speech. Experimental Brain Research, 213(2-3), 175-183.
Navarra, J.*, Alsius, A.*, Soto-Faraco, S. & Spence, C. (2010). Perception of audiovisual speech synchrony for native and non-native language. Brain Research, 1323, 84-93. * These authors contributed equally to the paper as first authors.
Navarra, J., Alsius, A., Soto-Faraco, S & Spence, C. (2010). Assessing the role of attention in the audiovisual integration of speech. Information Fusion, 11, 4-11.
Soto-Faraco, S. & Alsius, A. (2009). Observation: Deconstructing the McGurk-MacDonald illusion. Journal of Experimental Psychology: Human Perception and Performance, 35(2), 580-587.
Koppen, C., Alsius, A & Spence, C (2008). Semantic congruency and the Colavita visual dominance effect. Experimental Brain Research, 184(4), 533-46.
Alsius, A., Navarra, J., & Soto-Faraco, S (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183(3), 399-404.
Soto-Faraco, S. & Alsius, A. (2006). Conscious access to the unisensory components of a crossmodal illusion. Neuroreport, 18 (4), 347-350.
Alsius, A., Navarra, J., Campbell, R. & Soto-Faraco, S (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 9(15), 839-843.
Soto-Faraco, S., Sinnett, SC., Alsius, A., & Kingstone, A. (2005). Spatial orienting of tactile attention induced by gaze direction. Psychonomic Bulletin & Review, 12(6), 1024-1031.
Soto-Faraco, S., Navarra, J., Sinnett, S., Alsius, A. (2004). La re-unificación de los sentidos. Reseña del libro: The Handbook of Multisensory Proceses. Cognitiva, 16, 257-259.
Soto-Faraco, S., Navarra, J., & Alsius, A. (2004). Assessing automaticity in audiovisual speech integration: Evidence from the speeded classification task. Cognition, 92, 13-23. (PDF, 183 KB)
Book Chapters
Navarra, J., Sinnett, S., Alsius, A., Azanon, E., & Soto-Faraco, S. (in press). Percepcion Multisensorial. In En L. Fuentes & R. Rueda (Eds.) Mente y cerebro: De la Psicologia Experimental a la Neurociencia cognitiva.
Alsius, A.,MacDonald, E. & Munhall, K. (2013). Multi-modal speech perception. In K. Ochsner & S. Kosslyn (Eds.). The Oxford Handbook of Cognitive Neuroscience. Oxford University Press.
Soto-Faraco, S., Navarra, J., Alsius, A., & Campbell, R. (2005). Efectos de la atención en la integración audiovisual del habla. In Universidad de Valencia: Fundación Universidad-Empresa de Valencia (ADEIT) (Eds.) Atención y Procesamiento.
Daniel Nault, B.Sc., Psychology, Master's Candidate
Education: B.Sc. (Hon) Psychology, Queen’s University
Publications
Nault, D.R., & Munhall, K.G. (2020). Individual variability in auditory feedback processing: responses to real-time formant perturbations and their relation to perceptual acuity. The Journal of the Acoustical Society of America, 148(6), 3709-3721.
Former Graduate Students:
Dr. Nida Latif
Postdoctoral researcher in the Attention & Social Cognition Lab - Department of Psychology, McGill University
Dr. Celina Nahanni
Medical student at University of Toronto, Ontario
Dr. Takashi Mitsuya
Postdoctoral Fellow at University of Washington
Dr. Julie Buchan
Speech Scientist at Nuance Communications, Montreal, Quebec
Dr. Jamal Mansour
Lecturer in Psychology and Sociology at Queen Margaret University, Edinburgh
Amanda Wilson, MSc.
Family Physician, Toronto, Ontario
Ian Everdell, MSc.
Consultant User Experience & Market Research, Bracebridge, Ontario
Dr. Andrea Downie
Psychologist, Children's Hospital of Western Ontario, London, Ontario
Dr. Jeffery A. Jones
Professor, Psychology Department, Wilfrid Laurier University
Former Postdoctoral Fellows:
Dr. Ewen MacDonald
Associate Professor, Department of Electrical Engineering at Technical University of Denmark
Dr. Hilmi Dajani
Associate Professor, School of Information Technology and Engineering, University of Ottawa
Dr. David Purcell
Associate Professor, National Centre for Audiology, University of Western Ontario
Dr. Douglas M. Shiller
Associate Professor, School of Speech-Language Pathology and Audiology at l'Université de Montréal
Researcher at the CHU Sainte-Justine Research Centre
Dr. Karen Nicholson (1971-2007)
Formerly Assistant Professor, Department of Psychology, Mount Allison University
Memorialized by Science Atlantic “Karen Nicholson Award in Neuropsychology”
Dr. Jorge Lucero
Professor, Departamento de Matemática, Universidade de Brasilia
Dr. Michel Pitermann
INRIA Researcher, Laboratoire Parole et Langue, Université de Provence, Aix-en-Provence, France