Richard Johansson
Department of Computer Science, Lund University, Sweden
Pierre Nugues
Department of Computer Science, Lund University, Sweden
Download article
Published in: SIGRAD 2005 The Annual SIGRAD Conference Special Theme - Mobile Graphics
Linköping Electronic Conference Proceedings 16:5, p. 25-29
Published: 2005-11-23
ISBN:
ISSN: 1650-3686 (print), 1650-3740 (online)
This paper describes a system that automatically converts narratives into 3D scenes. The texts; written in Swedish; describe road accidents. One of the key features of the program is that it animates the generated scene using temporal relations between the events. We believe that this system is the first text-to-scene converter that is not restricted to invented narratives.
The system consists of three modules: natural language interpretation based on information extraction (IE) methods; a planning module that produces a geometric description of the accident; and finally a visualization module that uses Java3D to render the geometric description as animated graphics.
We performed a small user study to evaluate the quality of the visualization. The results validate our choice of methods; and since this is the first evaluation of a text-to-scene conversion system; they also provide a baseline for further studies.
CR Categories: H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems—Animations; I.2.7 [Artificial Intelligence]: Natural Language Processing—Text Analysis; I.2.8 [Artificial Intelligence]: Problem Solving; Control Methods; and Search—Plan execution; formation; and generation
ADORNI; G.; MANZO; M. D.; AND GIUNCHIGLIA; F. 1984. Natural language driven image generation. In Proceedings of COLING 84; 495–500.
ARENS; M.; OTTLIK; A.; AND NAGEL; H.-H. 2002. Natural language texts for a cognitive vision system. In ECAI2002; Proceedings of the 15th European Conference on Artificial Intelligence; F. van Harmelen; Ed.
CARLBERGER; J.; AND KANN; V. 1999. Implementing an efficient part-of-speech tagger. Software Practice and Experience 29; 815–832.
COYNE; B.; AND SPROAT; R. 2001. WordsEye: An automatic text-to-scene conversion system. In Proceedings of the Siggraph Conference.
DUPUY; S.; EGGES; A.; LEGENDRE; V.; AND NUGUES; P. 2001. Generating a 3D simulation of a car accident from a written description in natural language: The Carsim system. In ACL2001: Workshop on Temporal and Spatial Information Processing; 1–8.
JOHANSSON; R.; BERGLUND; A.; DANIELSSON; M.; AND NUGUES; P. 2005. Automatic text-to-scene conversion in the traffic accident domain. In IJCAI-05; Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence; 1073–1078.
