Conference article

End-to-End Infrastructure for Usability Evaluation of eHealth Applications and Services

Martin Gerdes
Department of Information and Communication Systems, University of Agder, Norway

Berglind Smaradottir
Department of Information and Communication Systems, University of Agder, Norway

Rune Fensli
Department of Information and Communication Systems, University of Agder, Norway

Download article

Published in: Scandinavian Conference on Health Informatics; August 22; 2014; Grimstad; Norway

Linköping Electronic Conference Proceedings 102:8, p. 53-59

Show more +

Published: 2014-08-20

ISBN: 978-91-7519-241-3

ISSN: 1650-3686 (print), 1650-3740 (online)


eHealth technologies are widely used in collaborative health care services involving multiple different user groups. A very important aspect of the design and development of such applications is the ease-of-use and user-friendliness of the user interface for the end-users. Usability testing is performed in a simulation or real environment to ensure that the system is adapted to the specific needs of the different end-users and to evaluate the interaction between users and system. The aim of this paper is to present an infrastructure for end-to-end usability testing of eHealth technologies in a con-trolled environment simulating both the Point-of-Care and the Health and Care Service Provider. The primary focus is on the requirements and technical aspects of the test infrastructure itself; but on top of that also a trial project is presented where the proposed usability testing infrastructure has been used and validated.


eHealth; health informatics; usability evaluation; end-to-end test infrastructure; point-of-care; user centered design


[1] Das A; Svanæs D. Human-centred methods in the design of an e-health solution for patients undergoing weight loss treatment. Int J Med Inform. 2013 11//;82(11):1075-91.

[2] United4Health. European-funded project United4Health 2014. Available from: Web-site of umbrella project: (English); Web-site of Norwegian project: (Norwegian).

[3] Kushniruk AW; Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform. 2004;37(1):56-76.

[4] Bastien JC. Usability testing: a review of some methodological and technical aspects of the method. Int J Med Inform. 2010;79(4):e18-e23.

[5] Jaspers M. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform. 2009;78(5):340-53.

[6] Rogers Y; Sharp H; Preece J. Interaction Design: Beyond Human-Computer Interaction: John Wiley & Sons; 2011.

[7] Lazar J; Feng JH; Hochheiser H. Research Methods in Human-Computer Interaction: Wiley; 2010.

[8] Samaras GM; Horst RL. A systems engineering perspective on the human-centered design of health information systems. J Biomed Inform. 2005 2//;38(1):61-74.

[9] Svanæs D; Alsos OA; Dahl Y. Usability testing of mobile ICT for clinical settings: Methodological and practical challenges. Int J Med Inform. 2010;79(4):e24-e34.

[10] Policy: World Medical Association Declaration of Helsinki. Ethical Principles for Medical Research Involving Human Subjects; (2009).

[11] Kushniruk AW; Patel C; Patel VL; Cimino JJ. Televaluation of clinical information systems: an integrative approach to assessing Web-based systems. Int J Med Inform. 2001;61:45-70.

[12] Kaufman DR; Patel VL; Hilliman C; Morin PC; Pevzner J; Weinstock RS; et al. Usability in the real world: assessing medical information technologies in patients’ homes. J Biomed Inform. 2003 2//;36(1–2):45-60.

[13] University of Surrey CIRG. ALFA Toolkit 2014. Available from:

Citations in Crossref