Using Participatory Heuristic Evaluation as a Collaborative Backbone in Large-Scale Projects - Preliminary Experience from the eWALL EU-Project

Clara Schaarup
Department of Health Science and Technology, Aalborg University, Denmark

Louise Pape-Haugaard
Department of Health Science and Technology, Aalborg University, Denmark

Stine Veje Hangaard
Department of Health Science and Technology, Aalborg University, Denmark

Albena Mihovska
Department of Electronic System, Aalborg University, Denmark

Gunnar Hartvigsen
Department of Computer Science, University of Tromsø – The Arctic University of Norway, Norway

Ole K. Hejlesen
Department of Health Science and Technology, Aalborg University, Denmark

Ladda ner artikel

Ingår i: SHI 2015, Proceedings from The 13th Scandinavien Conference on Health Informatics, June 15-17, 2015, Tromsø, Norway

Linköping Electronic Conference Proceedings 115:4, s. 19-24

Visa mer +

Publicerad: 2015-06-26

ISBN: 978-91-7685-985-8

ISSN: 1650-3686 (tryckt), 1650-3740 (online)


Worldwide, the number of collaboration activities and largescale projects (LSPs) increases. According to Harvard Business Review, LSPs contain several challenges related to strategy, interdependence, teaming, culture, norms, leadership, and different educational background. eWALL is an ongoing LSP with 14 partners where several evaluation methods are used, including Participatory Heuristic Evaluation. The applied method can be seen as a two-level approach: First, the eWALL system was evaluated using Participatory Heuristic Evaluation and, second, results of the Participatory Heuristic Evaluation were assessed by groups of project participants. Using the method and discussing the results in these meetings, not only focused on system improvements, but also facilitated fruitful discussions related to the overall goal, challenges, and progression in the project. Participatory Heuristic Evaluation proved useful for evaluating the system, and prompted the idea of using the formalism, i.e. as a collaborative backbone, at a higher managerial level to tackle some of the challenges associated with LSPs. In order to refine and prove the benefit of using Participatory Heuristic Evaluation as a collaborative backbone, further studies should be conducted.


collaborative backbone; participatory heuristic evaluation; preliminary project experience; large-scale project


[1] Powell W.W. Learning From Collaboration: Knowledge and Networkds in the Biotechnology and Pharmaceutical Industries. 1998;40(3), 227-240.

[2] Lu Y, Luo L, Wang H, Le Y, Shi Q. Measurement model of project complexity for large-scale projects from task and organization perspective. International Jounal of Project Management. 2015;33(3):610–22.

[3] Geraldi J, Maylor H, Williams T. Now, let’s make it really comlex (complicated). A systematic review of the complexities of projects. International Journal of Operation Management. 2011;31(9):966–90.

[4] Cross R, Ehrlich K, Dawson R, Helferich J. Managing Collaboration: Improving Team Effectiveness through a Network Perspective. California Management Review. 2012;52(2):147–58.

[5] Edmondson A.C. Teamwork on the fly. Spotlight on the secrets of great teams. Harvard Business Review. 2012;90(4), 1-10.

[6] The European Commision. FP7 in Brief: How to get involved in the Framework Programme for Research. 2007.

[7] The European Commision. Horizon 2020. The EU Framework Programme for Research and Innovation [Internet]. 2015. Available from: http://ec.europa.eu/programmes/horizon2020/

[8] Cooley L, Kohl R. Scaling Up — From Vision to Large-Scale Change. A Management Framework for Practitioners. Management Systems International. A Subsidiary of Coffey International. LTD 2012;(March):73, 3-45.

[9] Heifetz R, Laurie D.L. The Work of Leadership. Harvard Business Review. 2012. 1-17

[10] Porter ME. The five competitive forces that shape strategy. Harvard Business Review. 2008;86(1):78–93, 137.

[11] Sole D, Rossum Z Van. Cultivating Collaborative Capacity. Harvard Graduate School of Education. 2006;1–16.

[12] Porter ME. What is Strategy ? Harvard Bussiness Review. 1996, 1-22

[13] The eWALL Consortium. Seventh Framework Programme [Personalised health, active ageing, and independent living]. Annex I - “ Description of Work ” eWALL. 2013.

[14] Nielsen J. Usability Engineering. Morgan Kaufman. San Francisco, Calif: Elsevier Ltd; 1994. 362 p.

[15] Muller M, Matheson L, Page C, Gallup R. Methods & tools: participatory heuristic evaluation. Mag Interact. 1998;5(5):13–8.

[16] Nielsen J. How Long Do Users Stay on Web Pages? [Internet]. NN/g Nielsen Norman Group. 2011. p. 1–3. Available from: http://www.nngroup.com/articles/how-long-do-users-stay-on-web-pages/

[17] Samson LL, Pape-Haugaard LB, Søgaard M, Schønheyder HC, Hejlesen OK. Participatory Heuristic Evaluation of a Tablet Computer System for Clinical Microbiology. Stud Heal Technol Inform. 2014;205:910–4.

[18] Nielsen J. Kinect Gestural UI: First Impressions [Internet]. NN/g Nielsen Norman Group. 2010. p. 1–9. Available from: http://www.nngroup.com/-articles/kinect-gestural-ui-first-impressions/

[19] Nielsen J. Iterative User Interface Design. IEEE Comput. 1993;26(11):32–41.

Citeringar i Crossref