Conference article

Designing gestures for affective input: an analysis of shape; effort and valence

Petra Fagerberg
Stockholm University/KTH, Sweden

Anna Ståhl
Stockholm University/KTH, Sweden

Kristina Höök
Stockholm University/KTH, Sweden

Download article

Published in: MUM 2003. Proceedings of the 2nd International Conference on Mobile and Ubiquitous Multimedia

Linköping Electronic Conference Proceedings 11:11, p. 57-65

Show more +

Published: 2003-12-10


ISSN: 1650-3686 (print), 1650-3740 (online)


We discuss a user-centered approach to incorporating affective expressions in interactive applications; and argue for a design that addresses both body and mind. In particular; we have studied the problem of finding a set of affective gestures. Based on previous work in movement analysis and emotion theory [Davies; Laban and Lawrence; Russell]; and a study of an actor expressing emotional states in body movements; we have identified three underlying dimensions of movements and emotions: shape; effort and valence. From these dimensions we have created a new affective interaction model; which we name the affective gestural plane model. We applied this model to the design of gestural affective input to a mobile service for affective messages.


Affective interaction; gestures; user-centered design; mobile service


Andersson; G.; Höök; K.; Mourao; D.; Paiva; A. and Costa; M. (2002) Using a Wizard of Oz study to inform the design of SenToy; Proceedings of the conference on Designing interactive systems; ACM Press.

Ark; W.; Dryer; D. and Lu; D. (1999) The emotion mouse; Proceedings of HCI International 1999. Munich; Germany.

Bannon; L. (1991) From humans factors to humans actors: The role ofpsychology and human-computer interaction studies in system design; Design at Work: Cooperative Design of Computer Systems; J. Greenbaum and M. Kyngs; eds; Hillsdale; N.J.:Erlbaum.

Bordwell; D. and Thompson; K. (2001) Film Art; An Introduction; Sixth Edition; McGraw-Hill; New York; USA.

Bresin; R. and Friberg; A. (2000); Emotional Colouring of Computercontrolled Music Performances; Computer Music Journal; (24)4; pages 44-63.

Cassell; J. (1998) A Framework for Gesture Generation and Interpretation; Computer Vision in Human Machine Interaction; R. Cipolla and A. Pentlan; eds. Cambridge University Press; New York; USA.

Castelfranchi; C. (2000) Affective Appraisal versus Cognitive Evaluation in Social Emotions and Interactions; Affective Interactions; Towards a New Generation of Computer Interfaces; Ana Paiva; ed; Springer-Verlag; Berlin.

Cummings; J. N.; Kraut; R. and Kiesler; S. (2001) Do we visit; call; or email?: media matter in close relationships; Proceedings of the Conference on Human Factors and Computing Systems (CHI ’01); extended abstracts; Seattle; Washington; USA.

Davies; E. (2001) Beyond Dance; Laban’s Legacy of Movements Analysis; Brechin Books ltd.; London; UK.

Dourish; P. (2001) Where the action is. The Foundations of embodied Interaction; MIT Press; Cambridge; MA; USA.

Ekman; P. (1972) Emotion in the Human Face; Pergamon Press Inc.; New York; USA.

Fernandez; R.; Scheirer; J. and Picard; R. (1999) Expression glasses: a wearable device for facial expression recognition. MIT Media Lab Tech. Rep. 484.

Forlizzi; J.; Lee; J. and Hudson; S. E. (2003) The Kinedit System:Affective Messages Using Dynamic Texts; Proceedings of the conference on Human Factors in Computing Systems (CHI’03); Ft. Lauderdale; Florida; USA.

Gaver; W.W.; Beaver J. and Benford; S. (2003) Ambiguity as a Resource for Design; Proceedings of the conference on Human factors in computing systems (CHI’03); Ft. Lauderdale; Florida; USA.

Grinter; R; and Eldridge; M. (2003) Design for the socially mobile: Wan2tlk?: everyday text messaging; Proceedings of the conference on Human factors in computing systems (CHI’03); Ft. Lauderdale; Florida; USA.

Hummels; C. and Stappers; P.J. (1998) Meaningful Gestures for Human Computer Interaction: Beyond Hand Postures; Proceedings for the third IEEE international conference on Automatic Face & Gesture recognition (FG’98); Nara; Japan.

Höök; K.; Sengers; P. and Andersson; G. (2003) Sense and Sensibility: Evaluation and Interactive Art; Proceedings of the conference on Human factors in computing system (CHI’03); Ft. Lauderdale; Florida; USA.

Höök; K (forthcoming) User-Centred Design and Evaluation of Affective Interfaces; Evaluating ECAs; Pelachaud; C. and Ruttkay; Z. Kluwer.

Ishii; H.; and Ullmer; B. (1997) Tangible bits: Towards seamless interfaces between people; bits and atoms. Proceedings of Conference on Human Factors in Computing Systems (CHI’97). ACM Press.

Itten; J (1971) Kunst der Farbe; Otto Maier Verlag; Ravensburg.

Laban; R. and Lawrence F.C. (1974) Effort; Economy of Human Effort; Second Edition; Macdonald & Evans Ltd.; London; UK.

Long; A. C. Jr; Landay; J.A.; Rowe L. R. and Michiels; J. (2000) Visual Similarity of Pen Gesture; Proceedings of the conference on Human factors in computing system (CHI’2000); The Hague; Amsterdam.

Nishino’; H.; Utsumiya’; K.; Kuraoka; D. and Yoshioka; K. (1997) Interactive two-handed gesture interface in 3D virtual environments; Proceedings of the ACM symposium on Virtual reality software and technology; ACM Press; Lausanne; Switzerland.

Ortony A.; Clore G.L. and Collins A. (1988) The Cognitive Structure of Emotions; Cambridge University Press; Cambridge; UK.

Paiva; A. (Ed.) (2000) Affective Interactions; Towards a New Generation of Computer Interfaces; Springer-Verlag; Berlin.

Paiva; A.; Costa; M.; Chaves; R.; Piedade; M.; Mourão; D.; Sobral; D.; Höök; K.; Andersson; G.; and Bullock; A. (2003) SenToy: an Affective Sympathetic Interface; International Journal of Human Computer Studies; Volume 59; Issues 1-2; July 2003; Pages 227-235; Elsevier.

Picard; R. (1997) Affective Computing; MIT Press; Cambridge; MA; USA.

Roseman I.J.; Antoniou A.A. and Jose P.E. (1996) Appraisal Determinants of Emotions: Constructing a More Accurate and Comprehensive Theory; Cognition & Emotion; 10(3); Pages 241-277.

Russell; J.A. (1980) A Circumplex Model of Affect; Journal of Personality and Social Psychology; Vol. 39; No. 6; pages 1161-1178; American Psychological Association.

Ryberg; K. (1991) Levande färger; ICA Bokförlag; Västerås; Sweden.

Zhao; L. (2001) Synthesis and Acquisition of Laban Movement Analysis Qualitative Parameters for Communicative Gestures; PhD thesis; CIS; University of Pennsylvania.

Citations in Crossref