Publication: Autonomous Person-following Telepresence Robot Using Monocular Camera And Deep Learning Yolo
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
ARQII Publication
Abstract
Telepresence robots (TRs) are increasingly important for remote communication and collaboration, particularly in situations where physical presence is not possible. One key feature of TRs is person-following, which relies on the detection and distance estimation of individuals. This study proposes an autonomous person-following TR using a monocular camera and deep-learning YOLO for person detection and distance estimation. To compensate for the monocular camera's inability to provide depth information, a novel distance estimation algorithm based on focal length and person width is introduced. The estimated width information of the detected person is extracted from the bounding box generated by YOLO. A pre-trained model using the MS COCO dataset is employed with YOLO for the person detection task. For robot movement control, a region-based controller is proposed to enable the robot to move based on the detected person's location in the image captured by the camera. Finally, integration and deployment of the proposed method in the TR is carried out using the Robot Operating System (ROS). Experimental results demonstrate that the TR can successfully follow a person using the proposed algorithm, thus highlighting its effectiveness for person-following tasks.
Description
Applications of Modelling and Stimulation, Volume 8, Page (101–109)
Keywords
Person following, Service robot, Telepresence robot, You Only Look Once (YOLO)
Citation
Ahmad Amin Firdaus Sakri , Izzuddin Mat Lazim, Suffian At-Tsauri Mauzi , Musab Sahrim , Liyana Ramli and Aminurrashid Noordin Autonomous Person-Following Telepresence Robot Using Monocular Camera and Deep Learning YOLO. (2024). Applications of Modelling and Stimulation, 8, 101–109.