Helping hands? Gesture and self-repair in schizophrenia

Christine Howes
University of Gothenburg, Sweden

Mary Lavelle
King’s College London, UK

Pat Healey
Queen Mary University of London, UK

Julian Hough
Bielefeld University, Germany

Rose McCab
Exeter University, UK

Ladda ner artikel

Ingår i: Proceedings of LREC 2016 Workshop. Resources and Processing of Linguistic and Extra-Linguistic Data from People with Various Forms of Cognitive/Psychiatric Impairments (RaPID-2016), Monday 23rd of May 2016

Linköping Electronic Conference Proceedings 128:2, s. 9 to 13

Visa mer +

Publicerad: 2016-06-03

ISBN: 978-91-7685-730-4

ISSN: 1650-3686 (tryckt), 1650-3740 (online)


Successful social encounters require mutual understanding between interacting partners, and patients with schizophrenia are known to experience difficulties in social interaction. Several studies have shown that in general people compensate for verbal difficulties by employing additional multimodal resources such as hand gesture. We hypothesise that this will be impaired in patients with schizophrenia, and present a preliminary study to address this question. The results show that during social interaction, schizophrenia patients repair their own speech less. In addition, although increased hand gesture is correlated with increased self-repair in healthy controls, there is no such association in patients with schizophrenia, or their interlocutors. This suggests that multimodal impairments are not merely seen on an individual level but may be a feature of patients’ social encounters.


Gesture, Self-repair, Schizophrenia


Addington, J. and Addington, D. (2008). Social and cognitive functioning in psychosis. Schizophrenia research, 99(1):176–181.

Brennan, S. and Schober, M. (2001). How listeners compensate for disfluencies in spontaneous speech. Journal of Memory and Language, 44(2):274–296.

Caplan, R., Guthrie, D., and Komo, S. (1996). Conversational repair in schizophrenic and normal children. Journal of the American Academy of Child & Adolescent Psychiatry, 35(7):950 –958.

Colman, M. and Healey, P. G. T. (2011). The distribution of repair in dialogue. In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, pages 1563–1568, Boston, MA.

Ellgring, H. (1986). Nonverbal expression of psychological states in psychiatric patients. European archives of psychiatry and neurological sciences, 236(1):31–34.

Godfrey, J. J., Holliman, E., and McDaniel, J. (1992). SWITCHBOARD: Telephone speech corpus for research and development. In Proceedings of IEEE ICASSP-92, pages 517–520, San Francisco, CA.

Goodwin, C. (1979). The interactive construction of a sentence in natural conversation. In G. Psathas, editor, Everyday Language: Studies in Ethnomethodology, pages 97–121. Irvington Publishers, New York.

Healey, P. G. T., Lavelle, M., Howes, C., Battersby, S., and McCabe, R. (2013). How listeners respond to speaker’s troubles. In Proceedings of the 35th Annual Conference of the Cognitive Science Society, Berlin, July.

Healey, P. G. T., Plant, N., Howes, C., and Lavelle, M. (2015). When words fail: Collaborative gestures during clarification dialogues. In 2015 AAAI Spring Symposium Series: Turn-Taking and Coordination in Human-Machine Interaction.

Hough, J. and Purver, M. (2014). Strongly incremental repair detection. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar. Association for Computational Linguistics.

Howes, C., Purver, M., Healey, P. G. T., Mills, G. J., and Gregoromichelaki, E. (2011). On incrementality in dialogue: Evidence from compound contributions. Dialogue and Discourse, 2(1):279–311.

Howes, C., Hough, J., Purver, M., and McCabe, R. (2014). Helping, I mean assessing psychiatric communication: An application of incremental self-repair detection. In Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), pages 80–89, Edinburgh.

Johns, L. C., Rossell, S., Frith, C., Ahmad, F., Hemsley, D., Kuipers, E., and McGuire, P. (2001). Verbal self-monitoring and auditory verbal hallucinations in patients with schizophrenia. Psychological medicine, 31(04):705–715.

Kay, S. R., Flszbein, A., and Opfer, L. A. (1987). The positive and negative syndrome scale (panss) for schizophrenia. Schizophrenia bulletin, 13(2):261.

Lavelle, M., Healey, P. G. T., and McCabe, R. (2012). Is nonverbal communication disrupted in interactions involving patients with schizophrenia? Schizophrenia Bulletin.

Lavelle, M., Healey, P. G., and McCabe, R. (2013a). Is nonverbal communication disrupted in interactions involving patients with schizophrenia? Schizophrenia bulletin, 39(5):1150–1158.

Lavelle, M., Howes, C., Healey, P. G. T., and McCabe, R. (2013b). Speech and hand movement coordination in schizophrenia. In Proceedings of the TiGeR Tilberg gesture research meeting, Tilburg, June.

Lavelle, M., Healey, P. G., and McCabe, R. (2014). Participation during first social encounters in schizophrenia. PloS one, 9(1).

Lavelle, M., Dimic, S., Wildgrube, C., McCabe, R., and Priebe, S. (2015). Non-verbal communication in meetings of psychiatrists and patients with schizophrenia. Acta Psychiatrica Scandinavica, 131(3):197–205.

Leudar, I., Thomas, P., and Johnston, M. (1992). Selfrepair in dialogues of schizophrenics: Effects of hallucinations and negative symptoms. Brain and Language, 43(3):487–511.

Levelt, W. (1983). Monitoring and self-repair in speech. Cognition, 14(1):41–104.

McCabe, R., Healey, P. G. T., Priebe, S., Lavelle, M., Dodwell, D., Laugharne, R., Snell, A., and Bremner, S. (2013). Shared understanding in psychiatrist-patient communication: Association with treatment adherence in schizophrenia. Patient Education and Counselling.

Millman, Z. B., Goss, J., Schiffman, J., Mejias, J., Gupta, T., and Mittal, V. A. (2014). Mismatch and lexical retrieval gestures are associated with visual information processing, verbal production, and symptomatology in youth at high risk for psychosis. Schizophrenia Research, 158(1-3):64 – 68.

Monte, R. C., Goulding, S. M., and Compton, M. T. (2008). Premorbid functioning of patients with first-episode nonaffective psychosis: a comparison of deterioration in academic and social performance, and clinical correlates of premorbid adjustment scale scores. Schizophrenia research, 104(1):206–213.

Schegloff, E., Jefferson, G., and Sacks, H. (1977). The preference for self-correction in the organization of repair in conversation. Language, 53(2):361–382.

Seyfeddinipur, M. and Kita, S. (2014). Gestures and selfmonitoring in speech production. In Annual Meeting of the Berkeley Linguistics Society, volume 27, pages 457–464.

Citeringar i Crossref