HANDLING MULTIPLE EVENTS IN HYBRID BDI AGENTS WITH REINFORCEMENT LEARNING: A CONTAINER APPLICATION

Prasanna Lokuge, Damminda Alahakoon

2005

Abstract

Vessel berthing in a container port is considered as one of the most important application systems in the shipping industry. The objective of the vessel planning application system is to determine a suitable berth guaranteeing high vessel productivity. This is regarded as a very complex dynamic application, which can vastly benefited from autonomous decision making capabilities. On the other hand, BDI agent systems have been implemented in many business applications and found to have some limitations in observing environmental changes, adaptation and learning. We propose new hybrid BDI architecture with learning capabilities to overcome some of the limitations in the generic BDI model. A new “Knowledge Acquisition Module” (KAM) is proposed to improve the learning ability of the generic BDI model. Further, the generic BDI execution cycle has been extended to capture multiple events for a committed intention in achieving the set desires. This would essentially improve the autonomous behavior of the BDI agents, especially, in the intention reconsideration process. Changes in the environment are captured as events and the reinforcement learning techniques have been used to evaluate the effect of the environmental changes to the committed intentions in the proposed system. Finally, the Adaptive Neuro Fuzzy Inference (ANFIS) system is used to determine the validity of the committed intentions with the environmental changes.

Paper Citation

in Harvard Style

Lokuge P. and Alahakoon D. (2005). HANDLING MULTIPLE EVENTS IN HYBRID BDI AGENTS WITH REINFORCEMENT LEARNING: A CONTAINER APPLICATION . In Proceedings of the Seventh International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 972-8865-19-8, pages 83-90. DOI: 10.5220/0002518600830090

in Bibtex Style

@conference{iceis05,
author={Prasanna Lokuge and Damminda Alahakoon},
title={HANDLING MULTIPLE EVENTS IN HYBRID BDI AGENTS WITH REINFORCEMENT LEARNING: A CONTAINER APPLICATION},
booktitle={Proceedings of the Seventh International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2005},
pages={83-90},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002518600830090},
isbn={972-8865-19-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Seventh International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - HANDLING MULTIPLE EVENTS IN HYBRID BDI AGENTS WITH REINFORCEMENT LEARNING: A CONTAINER APPLICATION
SN - 972-8865-19-8
AU - Lokuge P.
AU - Alahakoon D.
PY - 2005
SP - 83
EP - 90
DO - 10.5220/0002518600830090