An exploration of the integration of speech with co-speech gesture with non-invasive brain stimulation

Zhao, Wanying

Psychology
September 2017

Thesis or dissertation


Rights
© 2017 Wanying Zhao. All rights reserved. No part of this publication may be reproduced without the written permission of the copyright holder.
Abstract

The current PhD project focuses on the integration of gesture with their co-occurring speech with the use of non-invasive brain stimulation. The project investigated ‘where’ and ‘when’ gesture-speech integration takes place. Building on the paradigm of Kelly et al., (2010) which provides a reaction time index of automatic gesture-speech integration, it was tested whether left middle temporal gyrus (pMTG) as well as left Inferior frontal gyrus (LIFG) are causally involved in gesture-speech integration. A follow-up study investigated the time window for this integration of gesture and speech in pMTG. This study found that gesture has a priming effect on the semantic retrieval of speech. This effect only manifested itself after gesture had been clearly understood and before the semantic analysis of speech. Based on the common coding hypothesis, this finding was interpreted in terms of gesture and speech originating from a common coding system, with both LIFG and pMTG as its neural underpining, enabling bi-directional influences between both domains.

Publisher
Department of Psychology, The University of Hull
Supervisor
Holle, Henning; Riggs, Kevin John; Schindler, Igor
Sponsor (Organisation)
China Scholarship Council
Qualification level
Doctoral
Qualification name
PhD
Language
English
Extent
2 MB
Identifier
hull:16482
QR Code