Conference article

Gestures become more informative after negative feedback

Marieke Hoetjes
Radboud University, Centre for Language Studies, Nijmegen, The Netherlands

Download article

Published in: Proceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016), Copenhagen, 29-30 September 2016

Linköping Electronic Conference Proceedings 141:8, p. 51-55

Show more +

Published: 2017-09-21

ISBN: 978-91-7685-423-5

ISSN: 1650-3686 (print), 1650-3740 (online)

Abstract

When objects or people are described repeatedly in conversation, the repeated references tend to be reduced variants of initial references. This can be seen both in speech, and in gesture. Previous studies focused on successful repeated references, produced in contexts of common ground. A question is whether repeated references are also reduced in contexts where there is less, or no common ground, for example during communicative problems. In particular, the present study asks whether gestures which are produced in repeated references following nega-tive feedback become more informative for the addressee. Participants viewed silent video clips, each showing one gesture, taken either from object descriptions before any feedback was given, or from object descriptions given after (repeated) negative feedback. With each video clip participants were shown two objects. The task was to decide which of the two objects was the target associated with the gesture they were shown. Results showed that participants were better at this task when presented with gestures produced following (repeated) negative feed-back. This leads us to conclude, firstly, that after having received negative feedback, gestures are not reduced, but become more informative, and secondly, that this might be done with the addressee in mind.

Keywords

No keywords available

References

Bard, E. G., Anderson, A. H., Sotillo, C., Aylett, M., Doherty-Sneddon, G., & Newlands, A. (2000). Controlling the intelligibility of referring expressions in dialogue. Journal of Memory and Language, 42, 1-22.

Clark, H., & Brennan, S. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & J. S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 127-149): American Psychological Association.

Clark, H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 22, 1-39.

Galati, A., & Brennan, S. (2014). Speakers adapt gestures to addressees’ knowledge: implications for models of co-speech gesture. Language, Cognition and Neuroscience, 29(4), 435-451. doi: 10.1080/01690965.2013.796397

Hoetjes, M., Koolen, R., Goudbeek, M., Krahmer, E., & Swerts, M. (2015). Reduction in gesture during the production of repeated references. Journal of Memory and Language, 79-80, 1-17.

Hoetjes, M., Krahmer, E., & Swerts, M. (2015). On what happens in gesture when communication is unsuccessful. Speech Communication, 72, 160-175.

Holler, J., & Wilkin, K. (2011). An experimental investigation of how addressee feedback affects co-speech gestures accompanying speakers’ responses. Journal of Pragmatics, 43, 3522–3536.

Jacobs, N., & Garnham, A. (2007). The role of conversational hand gestures in a narrative task. Journal of Memory and Language, 56, 291-303.

Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge: Cambridge University Press.

McNeill, D. (1992). Hand and mind. What gestures reveal about thought. Chicago: University of Chicago Press.

Citations in Crossref