REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS

Tommy Jensen, Mikkel S. Andersen, Claus B. Madsen

2006

Abstract

Knowledge about illumination conditions in a real world scene has many applications, among them Augmented Reality which aims at placing virtual objects in the real world. An important factor for convincing augmentations is to use the illumination of the real world when rendering the virtual objects so they are shaded consistently and cast consistent shadows. The work presented in this paper aims at making a robust system capable of estimating the lighting of an outdoor scene, and apply the light changes to the virtual augmented objects that are placed within a real scene. The method uses an Irradiance Volume, modified to use an environment map of a given scene, to mimic the multiple lights reflected in a scene using Image Based Lighting, while normal Phong shading is used to mimic the sun shading. These are combined with a Shadow Volume method to ensure shadow interaction with the surrounding environment. For every frame an Illumination Estimation approximates local illumination light parameters used in the rendering of the augmented objects. The light parameters are furthermore used to, at runtime, create new environment maps, to update the irradiance volume. The result is a rendering pipeline capable of handling dynamic light changes, and applies them to augmented objects within a given scene, enabling realistic augmentations under changing illumination conditions.

References

  1. Sato, I., Sato, Y., and Ikeuchi, K., 1999. Illumination distribution from shadows. In Proceedings: CVPR99.
  2. Debevec, P., 1998. Rendering synthetic objects into real scenes: Bridging traditional image-based graphics with global illumination and high dynamic range photography. In Proceedings: SIGGRAPH 1998.
  3. Gibson S., Cook, J., Howard, T., and Hubbold, R., 2003. Rapid shadow generation in real-world lighting environments. In Proceedings: EuroGraphics Symposium on Rendering.
  4. Greger, G., Shirley, P., Hubbard, P. M., and Greenberg, D. P., 1998. The irradiance volume. IEEE Computer Graphics and Applications.
  5. Whitehurst, A., 2001. Depth map based ambient occlusion lighting.
  6. Decaudin, P., 1996. Cartoon looking rendering of 3D scenes. Research Report 2919, INRIA.
  7. Jensen, T., and Andersen M., 2005. M. Sc. Thesis: Estimating and Applying Dynamic Light Changes to Environment Maps in Real-time for use in Image Based Lighting. Aalborg University.
  8. Crow, F.C., 1977. Shadow Algorithms for Computer Graphics. SIGGRAPH 7877 Proceedings.
  9. Kanbara, M., and Yokoya, N., 2004. Real-time estimation of light source environment for photorealistic augmented reality. In Proceedings of the 17th International Conference on Pattern Recognition.
Download


Paper Citation


in Harvard Style

Jensen T., S. Andersen M. and B. Madsen C. (2006). REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS . In Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 972-8865-39-2, pages 364-371. DOI: 10.5220/0001353703640371


in Bibtex Style

@conference{grapp06,
author={Tommy Jensen and Mikkel S. Andersen and Claus B. Madsen},
title={REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS},
booktitle={Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2006},
pages={364-371},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001353703640371},
isbn={972-8865-39-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS
SN - 972-8865-39-2
AU - Jensen T.
AU - S. Andersen M.
AU - B. Madsen C.
PY - 2006
SP - 364
EP - 371
DO - 10.5220/0001353703640371