Experimental Evaluation of Automatic Tests Cases in Data Analytics Applications Loading Procedures

Igor Peterson Oliveira Santos, Juli Kelle Góis Costa, Methanias Colaço Júnior, André Vinícius R. P. Nascimento

2017

Abstract

Business Intelligence (BI) relies on Data Warehouse (DW), a historical data repository designed to support the decision making process. Despite the potential benefits of a DW, data quality issues prevent users from realizing the benefits of a BI environment and Data Analytics. Problems related to data quality can arise in any stage of the ETL (Extract, Transform and Load) process, especially in the loading phase. This Paper presents an approach to automate the selection and execution of previously identified test cases for loading procedures in BI environments based on DW. To verify and validate the approach, a unit tests framework was developed. The overall goal is achieve efficiency improvement. The specific aim is reduce test effort and, consequently, promote test activities in data warehousing process. A controlled experiment evaluation in the industry carried out to investigate the adequacy of the proposed method against a generic framework for DW procedures development. Constructed specifically for database application tests, DbUnit was the generic framework chosen for the experiment by convenience of the programmers. The experiment's results show that our approach clearly reduces test effort when compared with execution of test cases using a generic framework.

Paper Citation

in Harvard Style

Oliveira Santos I., Góis Costa J., Colaço Júnior M. and R. P. Nascimento A. (2017). Experimental Evaluation of Automatic Tests Cases in Data Analytics Applications Loading Procedures . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-247-9, pages 304-311. DOI: 10.5220/0006337503040311

in Bibtex Style

@conference{iceis17,
author={Igor Peterson Oliveira Santos and Juli Kelle Góis Costa and Methanias Colaço Júnior and André Vinícius R. P. Nascimento},
title={Experimental Evaluation of Automatic Tests Cases in Data Analytics Applications Loading Procedures},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2017},
pages={304-311},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006337503040311},
isbn={978-989-758-247-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Experimental Evaluation of Automatic Tests Cases in Data Analytics Applications Loading Procedures
SN - 978-989-758-247-9
AU - Oliveira Santos I.
AU - Góis Costa J.
AU - Colaço Júnior M.
AU - R. P. Nascimento A.
PY - 2017
SP - 304
EP - 311
DO - 10.5220/0006337503040311