The role of conflict processing in multisensory perception: behavioural and electroencephalography evidence

Abstract

To form coherent multisensory perceptual representations, the brain must solve a causal inference problem: to decide if two sensory cues originated from the same event and should be combined, or if they came from different events and should be processed independently. According to current models of multisensory integration, during this process, the integrated (common cause) and segregated (different causes) internal perceptual models are entertained. In the present study, we propose that the causal inference process involves competition between these alternative perceptual models that engages the brain mechanisms of conflict processing. To test this hypothesis, we conducted two experiments, measuring reaction times (RTs) and electroencephalography, using an audiovisual ventriloquist illusion paradigm with varying degrees of intersensory disparities. Consistent with our hypotheses, incongruent trials led to slower RTs and higher fronto-medial theta power, both indicative of conflict. We also predicted that intermediate disparities would yield slower RTs and higher theta power when compared to congruent stimuli and to large disparities, owing to the steeper competition between causal models. Although this prediction was only validated in the RT study, both experiments displayed the anticipated trend. In conclusion, our findings suggest a potential involvement of the conflict mechanisms in multisensory integration of spatial information. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

This research was supported by grants from the Ministerio de Ciencia e Innovación (grant no. PID2019-108531GB-I00 AEI/FEDER) and PRESP05622 - PDC2022-133859-I00, and from AGAUR Generalitat de Catalunya (grant no. 2021 SGR 00911) to S.S.-F. A.M. is supported by the Ayudas para contratos predoctorales para la formación de doctores/as 2020 (grant no. PRE2020-093991).