Dynamic Indexing for Incremental Entity Resolution in Data Integration Systems

Priscilla Kelly M. Vieira, Bernadette Farias Lóscio, Ana Carolina Salgado

2017

Abstract

Entity Resolution (ER) is the problem of identifying groups of tuples from one or multiple data sources that represent the same real-world entity. This is a crucial stage of data integration processes, which often need to integrate data at query time. This task becomes even more challenging in scenarios with dynamic data sources or with a large volume of data. As most ER techniques deal with all tuples at once, new solutions have been proposed to deal with large volumes of data. One possible approach consists in performing the ER process on query results rather than the whole data set. It is also possible to reuse previous results of ER tasks in order to reduce the number of comparisons between pairs of tuples at query time. In a similar way, indexing techniques can also be employed to help the identification of equivalent tuples and to reduce the number of comparisons between pairs of tuples. In this context, this work proposes an indexing technique for incremental Entity Resolution processes. The expected contributions of this work are the specification, the implementation and the evaluation of the proposed indexes. We performed some experiments and the time spent for storing, accessing and updating the indexes was measured. We concluded that the reuse turns the ER process more efficient than the reprocessing of tuples comparison and with similar quality of results.

Paper Citation

in Harvard Style

Vieira P., Lóscio B. and Salgado A. (2017). Dynamic Indexing for Incremental Entity Resolution in Data Integration Systems . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-247-9, pages 185-192. DOI: 10.5220/0006251801850192

in Bibtex Style

@conference{iceis17,
author={Priscilla Kelly M. Vieira and Bernadette Farias Lóscio and Ana Carolina Salgado},
title={Dynamic Indexing for Incremental Entity Resolution in Data Integration Systems},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2017},
pages={185-192},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006251801850192},
isbn={978-989-758-247-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Dynamic Indexing for Incremental Entity Resolution in Data Integration Systems
SN - 978-989-758-247-9
AU - Vieira P.
AU - Lóscio B.
AU - Salgado A.
PY - 2017
SP - 185
EP - 192
DO - 10.5220/0006251801850192