P. Rojtberg
TU Darmstadt, Germany
A. Olwal
Kungliga Tekniska Högskolan, Sweden
Download article
Published in: Proceedings of SIGRAD 2010
Linköping Electronic Conference Proceedings 52:5, p. 17-26
Published: 2010-11-29
ISBN: 978-91-7393-281-3
ISSN: 1650-3686 (print), 1650-3740 (online)
We present a framework for tangible user interfaces on handheld devices through the use of augmented reality; where virtual objects can be manipulated and arranged using physical objects in the real world. Visual feedback is provided in the high-resolution handheld display; where virtual objects are overlaid onto live video from the camera. The virtual objects are registered and tracked in real-time relative to the physical environment using the device’s camera. Realistic lighting and rendering of high-resolution virtual models is achieved through hardwareaccelerated graphics and shadow mapping. The user can interact with the virtual objects and system parameters both through an overlaid menu interface and through direct touch-screen interaction. We describe our framework; our adaptation of the ARToolKitPlus tracking library for a mobile platform; and a number of interaction techniques that we implemented for a prototype urban planning application.
Categories and Subject Descriptors (according to ACM CCS): H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems—Artificial; augmented; and virtual realities; I.3.6 [Computer Graphics]: Methodology and techniques—Interaction techniques.
[BKP08] BILLINGHURST M.; KATO H.; POUPYREV I.: Tangible augmented reality. In ACM SIGGRAPH ASIA 2008 courses (2008); ACM; p. 7. 2
[Hen07] HENRYSSON A.: Bringing Augmented Reality to Mobile Phones. Linköpings universitet; Norrköping (2007). 3; 8
[HO04] HENRYSSON A.; OLLILA M.: UMAR: Ubiquitous mobileaugmented reality. In Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia (2004); ACM; p. 45. 3
[HPGK94] HINCKLEY K.; PAUSCH R.; GOBLE J.; KASSELL N.: A survey of design issues in spatial input. In Proceedings of the 7th annual ACM symposium on User interface software and technology (1994); ACM; p. 222. 2; 5
[LNBK04] LEE G.; NELLES C.; BILLINGHURST M.; KIM G.: Immersive authoring of tangible augmented reality applications. In Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality (2004); IEEE Computer Society; p. 181. 3
[MLB04] MOHRING M.; LESSIG C.; BIMBER O.: Video seethrough AR on consumer cell-phones. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality; 2004. ISMAR 2004 (2004); pp. 252–253. 3
[PTW98] POUPYREV I.; TOMOKAZU N.; WEGHORST S.: Virtual Notepad: handwriting in immersive VR. In Proceedings of the Virtual Reality Annual International Symposium (1998); Citeseer; pp. 126–132. 3; 5
[RN95] REKIMOTO J.; NAGAO K.: The world through the computer: Computer augmented interaction with real world environments. In Proceedings of the 8th annual ACM symposium on User interface and software technology (1995); ACM; p. 36. 2
[Sho92] SHOEMAKE K.: ARCBALL: a user interface for specifying three-dimensional orientation using a mouse. In Graphics Interface (1992); vol. 92; pp. 151–156. 2
[UI99] UNDERKOFFLER J.; ISHII H.: Urp: a luminous-tangible workbench for urban planning and design. In Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit (1999); ACM; pp. 386–393. 4
[WLS08] WAGNER D.; LANGLOTZ T.; SCHMALSTIEG D.: Robust and unobtrusive marker tracking on mobile phones. In Proceedings of the 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality-Volume 00 (2008); IEEE Computer Society; pp. 121–124. 3
[WRM08] WAGNER D.; REITMAYR G.; MULLONI A.; DRUMMOND T.; SCHMALSTIEG D.: Pose tracking from natural features on mobile phones. In 7th IEEE/ACM International Symposium on Mixed and Augmented Reality; 2008. ISMAR 2008 (2008); pp. 125–134. 3
[WS03] WAGNER D.; SCHMALSTIEG D.: First steps towards handheld augmented reality. In Proceedings of the 7th IEEE International Symposium on Wearable Computers (2003); Citeseer; p. 127. 3; 6
