MULTI-PROCESS OPTIMIZATION VIA HORIZONTAL MESSAGE QUEUE PARTITIONING

Matthias Boehm, Dirk Habich, Wolfgang Lehner

2010

Abstract

Message-oriented integration platforms execute integration processes—in the sense of workflow-based process specifications of integration tasks—in order to exchange data between heterogeneous systems and applications. The overall optimization objective is throughput maximization, i.e., maximizing the number of processed messages per time period. Here, moderate latency time of single messages is acceptable. The efficiency of the central integration platform is crucial for enterprise data management because both the data consistency between operational systems and the up-to-dateness of analytical query results depend on it. With the aim of integration process throughput maximization, we propose the concept of multi-process optimization (MPO). In this approach, messages are collected during a waiting period and executed in batches to optimize sequences of process instances of a single process plan. We introduce a horizontal—and thus, valuebased—partitioning approach for message batch creation and show how to compute the optimal waiting time with regard to throughput maximization. This approach significantly reduces the total processing time of a message sequence and hence, it maximizes the throughput while accepting moderate latency time.

Paper Citation

in Harvard Style

Boehm M., Habich D. and Lehner W. (2010). MULTI-PROCESS OPTIMIZATION VIA HORIZONTAL MESSAGE QUEUE PARTITIONING . In Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-8425-04-1, pages 5-14. DOI: 10.5220/0002862600050014

in Bibtex Style

@conference{iceis10,
author={Matthias Boehm and Dirk Habich and Wolfgang Lehner},
title={MULTI-PROCESS OPTIMIZATION VIA HORIZONTAL MESSAGE QUEUE PARTITIONING},
booktitle={Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2010},
pages={5-14},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002862600050014},
isbn={978-989-8425-04-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - MULTI-PROCESS OPTIMIZATION VIA HORIZONTAL MESSAGE QUEUE PARTITIONING
SN - 978-989-8425-04-1
AU - Boehm M.
AU - Habich D.
AU - Lehner W.
PY - 2010
SP - 5
EP - 14
DO - 10.5220/0002862600050014