INTERACTIVE MEDIA AND DESIGN EDITING FOR LIVE VISUALS APPLICATIONS

Pascal Müller, Simon Schubiger-Banz, Stefan Müller Arisona, Matthias Specht

2006

Abstract

This paper describes novel concepts for the interactive composition of artistic real-time graphics, so-called live visuals. By establishing two fundamental techniques dealing with the structured media integration and the intrinsic design process, we significantly increase the efficiency of interactive editing in live visuals applications. First, we present a media manager that supports the user in both retrieval and utilization of automatically annotated digital media. The computer-assisted application of individual media items permits the interactive control of non-linear editing (NLE) of video in real-time. Second, we optimize the design process by introducing the design tree, which collects and organizes the artist’s work in an intuitive way. Design tree operations provide interactive high-level editing methods which allow for exploration, combination, reuse, and evolution of designs before and particularly during the performance. We examined the effectiveness of our techniques on numerous long-lasting live performances from which representative examples are demonstrated.

References

  1. Brossier, P., Bello, J. P., and Plumbley, M. D. (2004). Realtime temporal segmentation of note objects in music signals. In Proceedings of the 2004 International Computer Music Conference. International Computer Music Association.
  2. Cederqvist, P. (1993). Version Management with CVS. Signum Support AB.
  3. Eisenstein, S. (1994). Selected Works 2: Towards a Theory of Montage. British Film Institute. Ed. by Nichael Glenny and Richard Taylor.
  4. Foote, J., Cooper, M., and Girgensohn, A. (2002). Creating music videos using automatic media analysis. Proc. ACM Intl. Conf. on Multimedia, pages 553-560.
  5. Fowler, M. (1999). Refactoring: Improving the Design of Existing Code. Addison-Wesley Object Technology Series. Addison-Wesley.
  6. GarageCube (2005). Modul8 real-time video mixing and compositing software. http://www.garagecube.com.
  7. Gorbmann, C. (1987). Unheard Melodies: Narrative Film Music. Indiana University Press.
  8. Goto, M. (2001). An audio-based real-time beat tracking system for music with or without drum sound. Journal of New Music Research, 30(2):158-171.
  9. Jehan, T., Lew, M., and Vaucelle, C. (2003). Cati dance: Self-edited, self-synchronized music video. In GRAPH 7803: Proceedings of the SIGGRAPH 2003 Conference on Sketches & Applications. ACM.
  10. Lienhard, R. (1999). Comparison of automatic shot boundary detection algorithms. In Image and Video Processing VII. Proc. SPIE 3656-29.
  11. Manjunath, B. S., Salembier, P., and Sikora, T. (2002). Introduction to MPEG-7: Multimedia Content Description Interface. John Wiley and Sons.
  12. Pukette, M. (2002). Max at seventeen. Computer Music Journal, 26(4):31-43.
  13. Ramakrishnan, R. and Ram, D. J. (1996). Modeling design versions. The VLDB Journal, pages 556-566.
  14. Rui, Y., Huang, T. S., and Mehrotra, S. (1999). Constructing table-of-content for videos. ACM Multimedia Systems, 7(5):359 - 368.
  15. Scheirer, E. (1998). Tempo and beat analysis of acoustic musical signals. J. Acoust. Soc. Am., 103(1):588-601.
  16. Schubiger, S. and Müller, S. (2003). Soundium2: An interactive multimedia playground. In Proceedings of the 2003 International Computer Music Conference. International Computer Music Association.
  17. Simon, H. A. (1996). The Sciences of the Artificial. MIT Press.
  18. Strauss, P. S. and Carey, R. (1992). An object-oriented 3D graphics toolkit. In Computer Graphics (Proceedings of SIGGRAPH 92), volume 26, 2, pages 341-349. ACM.
  19. Sutherland, I. E. (1963). Sketchpad, a Man-Machine Graphical Communication System. PhD thesis, Massachusetts Institute of Technology.
  20. Tseng, B. L., Lin, C.-Y., and Smith, J. R. (2002). Video personalization and summarization system. In Internet Multimedia Management Systems. SPIE Photonics East.
  21. Ulyate, R. and Bianciardi, D. (2002). The interactive dance club: Avoiding chaos in a multi-participant environment. Computer Music Journal, 26(3):40-49.
  22. VJCentral (2005). http://www.vjcentral.com.
  23. Wagner, M. G. and Carroll, S. (2001). Deepwave: Visualizing music with VRML. In VSMM 7801: Proceedings of the Seventh International Conference on Virtual Systems and Multimedia (VSMM'01), page 590. IEEE Computer Society.
  24. Wang, J., Bhat, P., Colburn, A., Agrawala, M., and Cohen, M. (2005). Interactive video cutout. In Proceedings of ACM SIGGRAPH 2005 / ACM Transactions on Graphics, volume 24, 3, pages 585-594. ACM.
  25. Wonka, P., Wimmer, M., Sillion, F., and Ribarsky, W. (2003). Instant architecture. In Proceedings of ACM SIGGRAPH 2003 / ACM Transactions on Graphics, volume 22, 3, pages 669-677. ACM.
Download


Paper Citation


in Harvard Style

Müller P., Schubiger-Banz S., Müller Arisona S. and Specht M. (2006). INTERACTIVE MEDIA AND DESIGN EDITING FOR LIVE VISUALS APPLICATIONS . In Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 972-8865-39-2, pages 232-242. DOI: 10.5220/0001358502320242


in Bibtex Style

@conference{grapp06,
author={Pascal Müller and Simon Schubiger-Banz and Stefan Müller Arisona and Matthias Specht},
title={INTERACTIVE MEDIA AND DESIGN EDITING FOR LIVE VISUALS APPLICATIONS},
booktitle={Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2006},
pages={232-242},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001358502320242},
isbn={972-8865-39-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - INTERACTIVE MEDIA AND DESIGN EDITING FOR LIVE VISUALS APPLICATIONS
SN - 972-8865-39-2
AU - Müller P.
AU - Schubiger-Banz S.
AU - Müller Arisona S.
AU - Specht M.
PY - 2006
SP - 232
EP - 242
DO - 10.5220/0001358502320242