Updating Strategies of Policies for Coordinating Agent Swarm in Dynamic Environments

Richardson Ribeiro, Adriano F. Ronszcka, Marco A. C. Barbosa, Fábio Favarim, Fabrício Enembreck

2013

Abstract

This paper proposes strategies for updating action policies in dynamic environments, and discusses the influence of learning parameters in algorithms based on swarm behavior. It is shown that inappropriate choices for learning parameters may cause delays in the learning process, or lead the convergence to an un-acceptable solution. Such problems are aggravated in dynamic environments, since the fit of algorithm pa-rameter values that use rewards is not enough to guarantee a satisfactory convergence. In this context, strat-egy-updating policies are proposed to modify reward values, thereby improving coordination between agents operating within dynamic environments. A framework has been developed which iteratively demonstrates the influence of parameters and updating strategies. Experimental results are reported which show that it is possible to accelerate convergence to a consistent global policy, improving the results achieved by classical approaches using algorithms based on swarm behavior.

Paper Citation

in Harvard Style

Ribeiro R., F. Ronszcka A., A. C. Barbosa M., Favarim F. and Enembreck F. (2013). Updating Strategies of Policies for Coordinating Agent Swarm in Dynamic Environments . In Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-8565-59-4, pages 345-356. DOI: 10.5220/0004443703450356

in Bibtex Style

@conference{iceis13,
author={Richardson Ribeiro and Adriano F. Ronszcka and Marco A. C. Barbosa and Fábio Favarim and Fabrício Enembreck},
title={Updating Strategies of Policies for Coordinating Agent Swarm in Dynamic Environments},
booktitle={Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2013},
pages={345-356},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004443703450356},
isbn={978-989-8565-59-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Updating Strategies of Policies for Coordinating Agent Swarm in Dynamic Environments
SN - 978-989-8565-59-4
AU - Ribeiro R.
AU - F. Ronszcka A.
AU - A. C. Barbosa M.
AU - Favarim F.
AU - Enembreck F.
PY - 2013
SP - 345
EP - 356
DO - 10.5220/0004443703450356