A Real-time 3D Surround View Pipeline for Embedded Devices

Onur Eker, Burak Ercan, Berkant Bayraktar, Murat Bal

2022

Abstract

In recent years, 3D surround view systems started to gain more attention as advanced driver assistance systems (ADAS) become more capable and intelligent. A 3D surround view system provides a 360-degree view of the environment surrounding the vehicle to enable the driver or operator to virtually observe its surroundings in a convenient way. In this paper we propose an end-to-end algorithm pipeline for 3D surround view systems, and show that it works in real-time on embedded devices. The proposed pipeline uses four cameras mounted around a vehicle for image acquisition. First, images are rectified and mapped to a spherical surface to generate 2D panorama view. In mapping step, a low-cost color correction is applied to provide a uniform scene in panorama. Lastly, generated panorama image is projected on a bowl-shaped mesh model to provide 360-degree view of the surrounding environment. The experimental results show that the proposed method works in real-time on desktop computers as well as on embedded devices (such as the NVIDIA Xavier); and generates less distorted, visually appealing 360-degree surround view of the vehicle.

Paper Citation

in Harvard Style

Eker O., Ercan B., Bayraktar B. and Bal M. (2022). A Real-time 3D Surround View Pipeline for Embedded Devices. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 257-263. DOI: 10.5220/0010766500003124

in Bibtex Style

@conference{visapp22,
author={Onur Eker and Burak Ercan and Berkant Bayraktar and Murat Bal},
title={A Real-time 3D Surround View Pipeline for Embedded Devices},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={257-263},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010766500003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - A Real-time 3D Surround View Pipeline for Embedded Devices
SN - 978-989-758-555-5
AU - Eker O.
AU - Ercan B.
AU - Bayraktar B.
AU - Bal M.
PY - 2022
SP - 257
EP - 263
DO - 10.5220/0010766500003124
PB - SciTePress