Conference article

An Investigation of the Effect of Beat and Iconic Gestures on Memory Recall in L2 Speakers

Eleni Ioanna Levantinou
Copenhagen University, Denmark

Costanza Navarretta
Copenhagen University, Denmark

Download article

Published in: Proceedings from the 3rd European Symposium on Multimodal Communication, Dublin, September 17-18, 2015

Linköping Electronic Conference Proceedings 105:6, p. 32-37

Show more +

Published: 2016-09-16

ISBN: 978-91-7685-679-6

ISSN: 1650-3686 (print), 1650-3740 (online)

Abstract

Previous studies have showed that iconic hand gestures aid memory recall and support comprehension in adults and children native speakers. In this paper, we investigate whether gestures might have an assisting role in second language acquisition. Repeating a previous experiment formed on native speakers, we used three types of stimuli (list of words accompanied by iconic gestures, beat gestures and no gestures) in order to test in which state the participants remember the most words. The result was that iconic gestures, compared to the other two states, provided significant support in memory recall and comprehension. However such an effect was not found with beat gestures whose presence gave worse results than the condition where no gestures were provided. This may indicate that beat gestures augmented the cognitive load of L2 speakers who have not learned yet how to interpret them.

Keywords

No keywords available

References

[1] So W. C., Chen-Hui C. S., Wei-Shan J. L. (2012). Mnemonic effect of iconic gesture and beat gesture in adults and children: is meaning in gesture important for memory recall? Lang. Cogn. Process. 27, 665–681

[2] Ekman, P. & Friesen W. V. (1972). Hand Movements. Journal of Communication, 22, 353-374.

[3] McNeill, D. (1992). Images, inside and out. In Hand and mind: What gestures reveal about thought (pp. 1135). Chicago, IL: University of Chicago Press.

[4] Kendon, A. (1994). Do gestures communicate? A review. Research on Language and Social Interaction, 27, 175–200.

[5] Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: some gestures are meant to be seen. Journal of Memory and Language, 44, 169–188.

[6] Ozyurek, A. (2002). Do speakers design their co speech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46, 688–704.

[7] Jacobs, N., & Garnham, A. (2006) The role of conversational hand gestures in a narrative task. Journal of Memory and Language, 26, 291-303.

[8] Goldin-Meadows, S., & McNeill, D. (1999). The role of gesture and mimetic representation in making language the province of speech. In M. Corballis & S. Lea (Eds.), The descent of mind (pp. 155–172). Oxford: Oxford University Press.

[9] Goldin-Meadow, S., Wein, D., & Chang, C. (1992). Assessing knowledge through gesture: Using children’s hands to read their minds. Cognition and Instruction, 9, 201– 219.

[10] Kelly, S. D., & Church, R. B. (1997). Can children detect conceptual information conveyed through other children’s nonverbal behaviors? Cognition and Instruction, 15, 107134.

[11] Kelly SD, Church RB. (1998). A comparison between children’s and adults’ ability to detect conceptual information conveyed through representational gestures. Child Development. 1998;69:85–93.

[12] Thompson, L. A., & Massaro, D. W. (1994). Children’s integration of speech and pointing gestures in comprehension. Journal of Experimental Child Psychology, 57, 327–354.

[13] McNeil, D., Cassell, J., & McCullough, K.E. (1994). Communicative effects of speech-mismatched gestures. Language and Social Interaction, 27, 223-237.

[14] Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577592.

[15] Cook, S. W., Mitchell, Z., & Goldin-Meadow, S. (2008). Gesturing makes learning last. Cognition, 106(2), 10471058.

[16] Stevanoni E., Salmon K. (2005). Giving memory a hand: instructing children to gesture enhances their event recall. J. Nonverbal Behav. 29, 217–233.

[17] Goldin-Meadow, S. & Wagner, S. M. (2005). How our hands help us learn. Trends in Cognitive Sciences, 2005, 9, 234-241.

[18] Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3(3), 149210.

[19] Baddeley, Alan (1990). Human memory: Theory and practice. East Sussex: Lawrence Erlbaum Associates Ltd. Publishers.

[20] Moreno, Roxanna & Richard E. Mayer (2000). A Learner-Centered Approach to Multimedia Explanations: Deriving Instructional Design Principles from Cognitive Theory. Interactive Multimedia Electronic Journal of Computer Enhanced Learning, 2 (2).

[21] Engelkamp, Johannes & Ronald L. Cohen (1991). Current issues in memory of action events. Psychological Research, 53, 175-182.

[22] Cohen, R. L., & Otterbein, N. (1992). The mnemonic effect of speech gestures: Iconic and non iconic gestures compared. European Journal of Cognitive Psychology, 4(2), 113139.

[23] Nyberg, L. (2002). Levels of processing: A view from functional brain imaging. Memory, 10(5), 345-348. Retrieved October 26, 2009, from the PsycINFO database.

[24] Tellier, Marion (2006). L’impact du geste pédagogique sur l’enseignement-apprentissage des étrangères: Etude sur des enfants de 5 ans. Unpublished Doctoral Dissertation. University Paris 7 – Denis Diderot, Paris.

[25] Tellier, M. (2008). The effect of gestures on second language memorization by young children. Gesture, 8(2), 219235.

[26] Gullberg, Marianne (2008). Gestures and second language acquisition. In Nick C. Ellis & Peter Robinson (Eds.), Handbook of cognitive linguistics and second language acquisition pp. 276-305). London: Routledge.

[27] Gullberg, M., Roberts, L., Dimroth, C., Veroude, K., & Indefrey, P. (2010). Adult language learning after minimal exposure to an unknown natural language. Language Learning, 60, 5–24.

[28] Macedonia M,, Bergmann K., Roithmayr F.(2014) Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Science Journal of Education. Vol. 2, No. 5, 2014, pp. 162-169.

[29] Morett, L. (2014) When Hands Speak Louder Than Words: The Role of Gesture in the Communication, Encoding, and Recall of Words in a Novel Second Language. The Modern Language Journal Volume 98, Issue 3, pages 834–853, Fall 2014.

[30] Holler J., Turner K. & Varcianna T. (2013). It’s on the tip of my fingers: Co-speech gestures during lexical retrieval in different social contexts. Language and Cognitive Processes, 28:10, 1509-1518.

[31] Pallant Julie, (2007). SPSS Survival Manual. A Step by Step Guide to Data Analysis using SPSS for Windows. Third edition. Open University Press.

[32] Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press.

[33] Gussenhoven, C., (2002). Intonation and interpretation: Phonetics and phonology. In Proceedings of Speech Prosody 2002, Aix-en-Provence.

[34] Quinn-Allen, L. (1995). The effects of emblematic gestures on the development and access of mental representations of French expressions. The Modern Language Journal, 79, 521529.

[35] Kelly, S. D., McDevitt, T., & Esch, M. (2009). Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processes, 24(2), 313334.

[36] Tellier, M. (2005). L’utilisation des gestes en classe de langue: comment e´valuer leur effet sur la memorisation du lexique? In M. Billieres, P. Gaillard, & N. Spanghero-Gaillard (Eds.) Actes du Colloque International de Didactique Cognitive, DidCog 2005. Proceedings on CD-Rom, Toulouse.

[37] Wagner, S., Nusbaum, H., & Goldin-Meadow, S. (2004). Probing the mental representation of gesture: Is handwaving spatial? Journal of Memory and Language, 50, 395407.

[38] Cohen, R. L., & Bean, G. (1983). Memory in educable mentally retarded adults: Deficits in subject or experimenter. Intelligence, 7, 287298.

[39] Nilsoon, L. G., & Craik, F. I. M. (1990). Addictive and interactive effects in memory for subject performed tasks. European Journal of Cognitive Psychology, 2, 305324.

[40] Feyereisen, P. (2006). Further investigations on the mnemonic effect of gestures: Their meaning matters. European Journal of Cognitive Psychology, 18, 185Á205.

[41] Goldin-Meadow, S., Nusbaum, H., Kelly, S. D.,& Wagner, S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12(6), 516–522.

[42] Brünken, R., Steinbacher, S., Plass, J. L., & Leutner, D. (2002). Assessment of cognitive load in multimedia learning using dual-task methodology. Experimental Psychology, 49, 109–119.

[43] Mayer, R. E., & Moreno, R. (1998). A split-attention effect in multimedia learning: Evidence for dual-processing systems in working memory. Journal of Educational Psychology, 90, 312-320

[44] Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20(4), 723–767.

[45] Grant, E. R., & Spivey, M. J. (2003). Eye movements and problem solving: Guiding attention guides thought. Psychological Science, 14 (5), 462-466.

Citations in Crossref