TOWARD 3D FREE FORM OBJECT TRACKING USING SKELETON

Djamel Merad, Jean-Yves Didier

2006

Abstract

In this paper we describe an original method for the 3D free form object tracking in monocular vision. The main contribution of this article is the use of the skeleton of an object in order to recognize, locate and track this object in real time. Indeed, the use of this kind of representation made it possible to avoid difficulties related to the absence of prominent elements in free form objects (which makes the matching process easier). The skeleton is a lower dimension representation of the object, it is homotopic and it has a graph structure. This allowed us to use powerful tools of the graph theory in order to perform matching between scene objects and models (recognition step). Thereafter, we used skeleton extremities as interest points for the tracking.

References

  1. Attali, D. and Montanvert, A. (1997). Computing & simplifying 2d & 3d continuous skeletons. In Computing Vision and Image Understanding, Vol 3, N 67, pages 261-273.
  2. Comport, A. I., Marchand, E., and Chaumette, F. (2003). A real-time tracker for markerless augmented reality. In Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 36-45.
  3. Drummond, T. and Cipolla, R. (2002). Real-time visual tracking of complex structures. In IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 24, N. 7, pages 932-946.
  4. Fabbri, R., Estozi, L., and da F. Costa, L. (2002). On voronoi diagrams and medial axes. In Journal of Mathematical Imaging and Vision, Vol 1, N 17, pages 27-40.
  5. Gennery, D. B. (1982). Tracking known three-dimensionnal objects. In Conf. American Association of Artificial Intelligence, pages 13-17.
  6. Gennery, D. B. (1992). Visual tracking of known threedimensionnal objects. In International Journal of Computer Vision vol. 8, pages 243-270.
  7. Harris, C. and Stennet, C. (1990). Rapid, a video rate object tracker. In British Machine Vision Conference, pages 73-77.
  8. Kegl, B. and Krzyzak, A. (2002). Piecewise linear skeletonization using principal curves. In IEEE Transactions on Pattern Analysis and machine Intelligence,vol. 1, N 24, pages 59-74.
  9. Lowe, D. G. (1987). Three-dimensional object recognition from single two-dimensional images. In Artificial Intelligence, vol. 31, no. 3, pages 355-395.
  10. Lowe, D. G. (1991). Fitting parametrized three-dimensional models to images. In IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 13, N 5, pages 441-450.
  11. Lowe, D. G. (1992). Robust model-based motion tracking through the integration of search and estimation. In International Journal of Computer Vision vol. 8, no. 2, pages 113-122.
  12. Lu, C., Hager, G. D., and Mjolsness, E. (2000). Fast and globally convergent pose estimation from video. In IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 22, N 6, pages 610-622.
  13. Macrini, D., Shokoufandeh, A., Dickinson, S., Siddiqi, K., and Zucker, S. (2002). View-based 3-d object recognition using shock graphs. In Proc. 16 Th Internatonal Conference on Pattern Recognition, Quebec.
  14. Malandain, G. and Fernandez-Vidal, S. (1998). Euclidean skeletons. In Image and Vision Computing, vol. 16, pages 317-327.
  15. Marchand, E., Bouthemy, P., Chaumette, F., and Moreau, V. (1999). Robust real-time visual tracking using a 2d-3d model-based approach. In International Conference on Computer Vision vol. 1, pages 262-268, Greece.
  16. Nilsson, F. and Danielsson, P. (1997). Finding the minimal set of maximum disks for binary objects. In Graphical Models and Image Processing, N 59, vol. 1, pages 55- 60.
  17. Shokoufandeh, A. and Dickinson, S. (1999). Applications of bipartite matching to problems in object recognition. In Pro., ICCV Workshop on Graph Algorithms and Computer Vision.
  18. Siddiqi, K., Shokoufandeh, A., Dickinson, S. J., and Zucker, S. (1999). Shock graphs and shape matching. In International Journal of Computer Vision, Vol 35, N 1, pages 13-32.
  19. Skrypnyk, I. and Lowe, D. (2004). Scene modelling, recognition and tracking with invariant image features. In Proceedings of the The 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 110-117, Arlington,VA.
  20. Tek, H. and Kimia, B. (1998). Curve evolution, wave propagation and mathematical morphology. In fourth International Symposium on mathematical Morphology.
  21. Vacchetti, L., Lepetit, V., and Fua, P. (2004). Stable realtime 3d tracking using online and offline information. In IEEE Transaction on Pattern Analysis and Machine, vol. 26, N 10, pages 1385-1391.
Download


Paper Citation


in Harvard Style

Merad D. and Didier J. (2006). TOWARD 3D FREE FORM OBJECT TRACKING USING SKELETON . In Proceedings of the Third International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-972-8865-60-3, pages 74-81. DOI: 10.5220/0001207400740081


in Bibtex Style

@conference{icinco06,
author={Djamel Merad and Jean-Yves Didier},
title={TOWARD 3D FREE FORM OBJECT TRACKING USING SKELETON},
booktitle={Proceedings of the Third International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2006},
pages={74-81},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001207400740081},
isbn={978-972-8865-60-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - TOWARD 3D FREE FORM OBJECT TRACKING USING SKELETON
SN - 978-972-8865-60-3
AU - Merad D.
AU - Didier J.
PY - 2006
SP - 74
EP - 81
DO - 10.5220/0001207400740081