Reinforcement-learning-based route generation for heavy-traffic autonomous mobile robot systems

Dominik Kozjek (Author), Andreja Malus (Author), Rok Vrabič (Author)

Abstract

Autonomous mobile robots (AMRs) are increasingly used in modern intralogistics systems as complexity and performance requirements become more stringent. One way to increase performance is to improve the operation and cooperation of multiple robots in their shared environment. The paper addresses these problems with a method for off-line route planning and on-line route execution. In the proposed approach, pre-computation of routes for frequent pick-up and drop-off locations limits the movements of AMRs to avoid conflict situations between them. The paper proposes a reinforcement learning approach where an agent builds the routes on a given layout while being rewarded according to different criteria based on the desired characteristics of the system. The results show that the proposed approach performs better in terms of throughput and reliability than the commonly used shortest-path-based approach for a large number of AMRs operating in the system. The use of the proposed approach is recommended when the need for high throughput requires the operation of a relatively large number of AMRs in relation to the size of the space in which the robots operate.

Keywords

intralogistika;avtonomni mobilni roboti;spodbujevalno učenje;intralogistics;autonomous mobile robots;multi-robot cooperation;reinforcement learning;route planning;

Data

Language:	English
Year of publishing:	2021
Typology:	1.01 - Original Scientific Article
Organization:	UL FS - Faculty of Mechanical Engineering
UDC:	007.52(045)
COBISS:	76747779
ISSN:	1424-8220
Views:	247
Downloads:	84
Average score:	0 (0 votes)
Metadata:

Other data

Secondary language:	Slovenian
Secondary keywords:	intralogistika;avtonomni mobilni roboti;spodbujevalno učenje;
Type (COBISS):	Article
Pages:	str. 1-19
Volume:	ǂVol. ǂ21
Issue:	ǂiss. ǂ14
Chronology:	Jul. 2021
DOI:	10.3390/s21144809
ID:	13462447