Autonomous person-following telepresence robot using monocular camera and deep learning YOLO

Mat Lazim, Izzuddin and Sakri, Ahmad Amin Firdaus and Mauzi, Suffian At-Tsauri and Sahrim, Musab and Ramli, Liyana and Noordin, Aminurrashid (2024) Autonomous person-following telepresence robot using monocular camera and deep learning YOLO. Applications of Modelling and Simulation, 8. pp. 101-109. ISSN 2600-8084

Text 01084260420249539774.PDF Download (1MB)

Abstract

Telepresence robots (TRs) are increasingly important for remote communication and collaboration, particularly in situations where physical presence is not possible. One key feature of TRs is person-following, which relies on the detection and distance estimation of individuals. This study proposes an autonomous person-following TR using a monocular camera and deep-learning YOLO for person detection and distance estimation. To compensate for the monocular camera's inability to provide depth information, a novel distance estimation algorithm based on focal length and person width is introduced. The estimated width information of the detected person is extracted from the bounding box generated by YOLO. A pre-trained model using the MS COCO dataset is employed with YOLO for the person detection task. For robot movement control, a region-based controller is proposed to enable the robot to move based on the detected person's location in the image captured by the camera. Finally, integration and deployment of the proposed method in the TR is carried out using the Robot Operating System (ROS). Experimental results demonstrate that the TR can successfully follow a person using the proposed algorithm, thus highlighting its effectiveness for person-following tasks.

Item Type:	Article
Uncontrolled Keywords:	Person following, Service robot, Telepresence robot, You Only Look Once (YOLO)
Divisions:	Faculty Of Electrical Technology And Engineering
Depositing User:	Sabariah Ismail
Date Deposited:	25 Jul 2024 11:33
Last Modified:	25 Jul 2024 11:33
URI:	http://eprints.utem.edu.my/id/eprint/27514
Statistic Details:	View Download Statistic

Actions (login required)

View Item