Konferensartikel

Can gestures change perceived meaning of ambiguous motion events Evidence from Italian verb-particle constructions

Bjørn Wessel-Tolvig
University of Copenhagen, CST, Denmark

Patrizia Paggio
University of Copenhagen, CST, Denmark / University of Malta, ILLT

Ladda ner artikel

Ingår i: Proceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016), Copenhagen, 29-30 September 2016

Linköping Electronic Conference Proceedings 141:9, s. 56-65

Visa mer +

Publicerad: 2017-09-21

ISBN: 978-91-7685-423-5

ISSN: 1650-3686 (tryckt), 1650-3740 (online)

Abstract

How sensitive are Italian speakers to information provided by co-speech gestures when interpreting ambiguous motion events? Verb + particle constructions are not suitable for expressing telic motion (change of location across a spatial boundary) in verb-framed languages like Italian. However, this constraint may perhaps be disregarded with certain type of manner verbs + complex PPs. The reading often depends on contextual inference or pragmatic clues. We present two experimental judgment tasks in which we first test whether grammatically locative Italian verb + particle constructions can be interpreted as boundary-crossing motion and secondly we investigate the effect of gestural information on the same type of locative events. The study confirms the existence of boundary-crossing interpretations for certain types of Italian manner verb + PP constructions, but more importantly that co-speech gestures can change the reading of events and thus override default meaning expressed only in speech.

Nyckelord

Inga nyckelord är tillgängliga

Referenser

Jon Aske. 1989. Path predicates in English and Spanish: A closer look. In Berkeley Linguistic Society 15, Berkeley, USA.

Panos Athanasopoulos and Emanuel Bylund. 2013. The ’thinking’ in thinking-for-speaking: Where is it? Language, Interaction & Acquisition, 4(1):91–100.

Valeria Bandecchi. 2012. Prepositional phrases and manner-of-motion verbs in Italian. In 22nd Colloquium on Generative Grammar, Barcelona, Spain.

Geoffrey Beattie and Heather Shovelton. 1999. Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? an experimental investigation. Semiotica, 123(1-2):1–30.

John Beavers, Beth Levin, and Shiao Wei Tham. 2010. The typology of motion expressions revisited. Journal of Linguistics, 46(2):331–377.

Ruth Aronson Berman and Dan Isaac Slobin. 1994. Relating events in narrative: A crosslinguistic developmental study. Psychology Press, Hillsdale, NJ.

Teresa Cadierno and Lucas Ruiz. 2006. Motion events in Spanish l2 acquisition. Annual Review of Cognitive Linguistics, 4:183–216.

Teresa Cadierno, 2012. Thinking for speaking in second language acquisition. Wiley-Blackwell.

Filippo-Enrico Cardini. 2008. Manner of motion saliency: An inquiry into Italian. Cognitive Linguistics, 19(4):533–569.

Filippo-Enrico Cardini. 2012. Grammatical constraints and verb-framed languages: The case of Italian. Language and Cognition, 4(3):167–201.

William Croft, Jhanna Bardal, Willem Hollmann, Violeta Sotirova, and Chiaki Taoka, 2010. Revising Talmys typological classification of complex event constructions, pages 201–235. John Benjamins.

Anthony Steven Dick, Susan Goldin-Meadow, Uri Hasson, Jeremy I. Skipper, and Steven L. Small. 2009. Cospeech gestures influence neural activity in brain regions associated with processing semantic information. Human brain mapping, 30(11):3509–3526.

Raffaella Folli and Gillian Ramchand, 2005. Prepositions and Results in Italian and English: An Analysis from Event Decomposition, volume 32 of Studies in Theoretical Psycholinguistics, book section 5, pages 81–105. Springer Netherlands.

Raffaella Folli, 2008. Complex PPs in Italian, pages 197–221. John Benjamins Publishing Company.

Berit Gehrke. 2007. On directional readings of locative prepositions. In ConSOLE XIV, pages 99–120, Vitoria-Gasteiz.

Whitney Goodrich Smith and Carla Hudson Kam. 2012. Knowing ’who she is’ based on ’where she is’: The effect of co-speech gesture on pronoun comprehension. Language & Cognition (De Gruyter), 4(2):75–98.

Whitney Goodrich Smith and Carla Hudson Kam. 2015. Children’s use of gesture in ambiguous pronoun interpretation. Journal of Child Language, 42(03):591–617.

Marianne Gullberg, 2011. Thinking, speaking and gesturing about motion in more than one language, book section 5, pages 143–169. Multilingual Matters.

Simon Harrison. 2011. The creation and implementation of a gesture code for factory communication. In GESPIN 2011 Gesture Conference, Bielefeld, Germany.

Alberto Hijazo-Gasccn and Iraide Ibarretxe-Antu˜nano, 2013. Same family, different paths. John Benjamins.

Henning Holle and Thomas C. Gunter. 2007. The role of iconic gestures in speech disambiguation: Erp evidence. Journal of Cognitive Neuroscience, 19(7):1175–1192.

Claudio Iacobini and Francesca Masini. 2006. The emergence of verb-particle constructions in Italian: locative and actional meanings. Morphology, 16:155–188.

Claudio Iacobini and Carla Vergaro. 2014. The role of inference in motion event encoding / decoding: a crosslinguistic inquiry into English and Italian. Lingue e linguaggio, 2:211–240.

Spencer Kelly, Asli Özyürek, and Eric Maris. 2010. Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21(2):260–267.

Spencer Kelly, Meghan L Healey, Asli Özyürek, and Judith Holler. 2014. The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin & Review, 22(2).

Adam Kendon, 1980. Gesture and speech: two aspects of the process of utterance, pages 207–227. Mouton.

Sotaro Kita and Asli Özyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1):16–32.

Sotaro Kita, Asli Özyürek, Shanley Allen, Amanda Brown, Reyhan Furman, and Tomoko Ishizuka. 2007. Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes, 22(8):1212–1236.

Jaume Mateu and Gemma Rigau. 2010. Verb-particle constructions in romance: A lexical-syntactic account. Probus, 22(2):241–269.

David McNeill. 1992. Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago.

David McNeill. 2000. Language and gesture. Cambridge University Press, Cambridge, UK.

David McNeill. 2005. Gesture & Thought. The University of Chicago Press, Chicago.

Asli Özyürek, Sotaro Kita, Shanley Allen, Reyhan Furman, and Amanda Brown. 2005. How does linguistic framing of events influence co-speech gestures?: Insights from crosslinguistic variations and similarities. Gesture, 5(1-1):219–240.

Dan Isaac Slobin and N Hoiting. 1994. Reference to movement in spoken and signed languages: Typological considerations. In Twentieth Annual Meeting of the Berkeley Linguistics Society, pages 487–505, Berkeley, USA.

Dan Isaac Slobin. 1987. Thinking for speaking. In Thirteenth Annual Meeting of the Berkeley Linguistics Society, pages 435–444, Berkeley, USA.

Dan Isaac Slobin, 1996. From thought and language to thinking for speaking, pages 70–96. Cambridge University Press.

Dan Isaac Slobin, 2004. The many ways to search for a frog: Linguistic typology and the expression of motion events, pages 219–257. Lawrence Erlbaum Associates.

Gale Stam. 2006. Thinking for speaking about motion: L1 and l2 speech and gesture. International Review of Applied Linguistics, 44:143–169.

Leonard Talmy, 1985. Semantics and syntax of motion, volume 3, pages 57–149. Cambridge UniversityPress.

Leonard Talmy. 1991. Path to realization: A typology of event conflation. In Seventeenth Annual Meeting of the Berkeley Linguistics Society, pages 480–519, Berkeley, USA.

Leonard Talmy. 2000. Toward a Cognitive Semantics: Typology and Process in Concept Structuring, volume II. The MIT Press, Cambridge.

Bjørn Wessel-Tolvig and Patrizia Paggio. 2016. Revisiting the thinking-for-speaking hypothesis: Speech and gesture representation of motion in Danish and Italian. Journal of Pragmatics, 99:39–61.

Bjørn Wessel-Tolvig. 2015. Breaking boundaries: How gestures reveal conceptualization of boundary-crossing in Italian. In Gespin 4, Nantes, France.

Citeringar i Crossref