This paper attempts to draw attention of the multimodal communication research community to what we consider a long overdue topic, namely respiratory activity in conversation. We submit that a turn towards spontaneous interaction is a natural extension of the recent interest in speech breathing, and is likely to offer valuable insights into mechanisms underlying organisation of interaction and collaborative human action in general, as well as to make advancement in existing speech technology applications. Particular focus is placed on the role of breathing as a perceptually and interactionally salient turn-taking cue. We also present the recording setup developed in the Phonetics Laboratory at Stockholm University with the aim of studying communicative functions of physiological and audio-visual breathing correlates in spontaneous multiparty interactions.
Kätlin Aare, Marcin Wlodarczak, and Mattias Heldner. 2014. Backchannels and breathing. In Proceedings of FONETIK 2014, pages 47–52, Stockholm, Sweden.
Gérard Bailly, Am´elie Rochet-Capellan, and Coriandre Vilain. 2013. Adaptation of respiratory patterns in collaborative reading. In Proceedings of Interspeech 2013, pages 1653–1657, Lyon, France.
Norbert Braunschweiler and Langzhou Chen. 2013. Automatic detection of inhalation breath pauses for improved pause modelling in HMM-TTS. In Proceedings of the 8th ISCA Speech Synthesis Workshop, pages 1–6, Barcelona, Spain.
John Butzberger, Hy Murveit, Elizabeth Shriberg, and Patti Price. 1992. Spontaneous speech effects in large vocabulary speech recognition applications. In Proceedings of the workshop on Speech and Natural Language, pages 339–343. Association for Computational Linguistics.
Susanne Fuchs, Caterina Petrone, Jelena Krivokapié, and Philip Hoole. 2013. Acoustic and respiratory evidence for utterance planning in German. Journal of Phonetics, 41(1):29–47.
Koji Hayashi, Nobuhiro Furuyama, and Hiroki Takase. 2005. Intra-and inter-personal coordination of speech, gesture and breathing movements. Transactions of the Japanese Society for Artificial Intelligence, 20(3):247–258.
Jeannette D. Hoit, Nancy Pearl Solomon, and Thomas J. Hixon. 1993. Effect of lung volume on voice onset time (VOT). Journal of Speech, Language and Hearing Research, 36(3):516–521.
Jessica E. Huber, Bharath Chandrasekaran, and John J. Wolstencroft. 2005. Changes to respiratory mechanisms during speech as a result of different cues to increase loudness. Journal of Applied Physiology, 98(6):2177–2184.
Ryo Ishii, Kazuhiro Otsuka, Shiro Kumano, and Junji Yamato. 2014. Analysis of respiration for prediction of “who will be next speaker and when?” in multi-party meetings. In Proceedings of the 16th ACM International Conference on Multimodal Interaction (ICMI 2014), pages 18–25, Istambul, Turkey.
Kimio Konno and Jere Mead. 1967. Measurement of the separate volume changes of rib cage and abdomen during breathing. Journal of Applied Physiology, 22(3):407–422.
John Local and John Kelly. 1986. Projection and ‘silences’: Notes on phonetic and conversational structure. Human studies, 9(2):185–204.
David H McFarland and Anne Smith. 1992. Effects of vocal task and respiratory phase on prephonatory chest wall movements. Journal of Speech and Hearing Research, 35(5):971–982.
David H. McFarland. 2001. Respiratory markers of conversational interaction. Journal of Speech, Language and Hearing Research, 44(1):128–143.
Raffaella Pellegrini and Maria Rita Ciceri. 2012. Listening to and mimicking respiration: Understanding and synchronizing joint actions. Review of Psychology, 19(1):17–27.
Md. Mahbubur Rahman, Amin Ahsan Ali, Kurt Plarre, Mustafa al’Absi, Emre Ertin, and Santosh Kumar. 2011. mConverse: Inferring conversation episodes from respiratory measurements collected in the field. In Proceedings of the 2nd Conference on Wireless Health, pages 1–10, San Diego, CA.
Amélie Rochet-Capellan and Susanne Fuchs. 2013. Changes in breathing while listening to read speech: the effect of reader and speech mode. Frontiers in Psychology, 4(906):1–15.
Am´elie Rochet-Capellan and Susanne Fuchs. 2014. Take a breath and take the turn: How breathing meets turns in spontaneous dialogue. Philosophical Transactions of the Royal Society B, 369(1658):1–10.
Emanuel A. Schegloff. 1996. Turn organization: One intersection of grammar and interaction. Studies in Interactional Sociolinguistics, 13:52–133.
Kevin Shockley, Daniel C. Richardson, and Rick Dale. 2009. Conversation and coordinative structures. Topics in Cognitive Science, 1(2):305–319.
Janet Slifka. 2006. Some physiological correlates to regular and irregular phonation at the end of an utterance. Journal of Voice, 20(2):171–186.
H. Watson. 1980. The technology of respiratory inductive plethysmography. In F. D. Stott, E. B. Raftery, and L. Goulding, editors, Proceeding of the Second International Symposium on Ambulatory Monitoring (ISAM 1979), pages 537–563, London. Academic Press.
Doug H. Whalen and Sonya M. Sheffert. 1996. Perceptual use of vowel and speaker information in breath sounds. In H. Timothy Bunnell and William Idsardi, editors, Proceedings of ICSLP 96, pages 2494–2497.
Doug H. Whalen, Charles E. Hoequist, and Sonya M. Sheffert. 1995. The effects of breath sounds on the perception of synthetic speech. The Journal of the Acoustical Society of America, 97:3147–3153.
Colin W. Wightman and Mari Ostendorf. 1994. Automatic labeling of prosodic patterns. IEEE Transactions on Speech and Audio Processing, 2(4):469–481.
Alison L. Winkworth, Pamela J. Davis, Roger D. Adams, and Elizabeth Ellis. 1995. Breathing patterns during spontaneous speech. Journal of Speech, Language and Hearing Research, 38(1):124–144.
