Home > Published Issues > 2023 > Volume 12, No. 6, November 2023 >
IJEETC 2023 Vol.12(6): 433-441
doi: 10.18178/ijeetc.12.6.433-441

Hand Gesture Recognition and Control for Human-Robot Interaction Using Deep Learning

Philip Jonah Ezigbo1, Onyebuchi Chikezie Nosiri2,*, Ekene Samuel Mbonu1, Victor Ofor1, and Jude Obichere1
1. Department of Mechatronics Engineering, Federal University of Technology Owerri, Nigeria
2. Department of Telecommunication Engineering, Federal University of Technology Owerri, Nigeria

Manuscript received June 3, 2023; revised August 7, 2023; accepted August 12, 2023.

Abstract—This paper introduces a real-time system for recognizing hand gestures using Python and OpenCV, centred on a Convolutional Neural Network (CNN) model. The primary objective of this study is to address the challenge of recognizing hand gestures in varied and complex environments. The proposed approach employs several image and video processing techniques, including data augmentation and feature extraction, to segment the hand region and extract relevant features. The system’s performance is significantly improved by adding to the original training dataset, resulting in 5,000 images with 500 images per gesture, as shown by the evaluation metrics indicating a substantial increase in accuracy from 96.9% to 99.2%. This paper aims to provide feasible and economical solutions for utilizing robots in industrial settings, while also proposing future research possibilities for enhancing human-robot interaction through methods such as incorporating hand gesture recognition.

 
Index Terms—Convolutional neural networks, computer vision, deep learning, hand gesture recognition, human-robot interaction

Cite: Philip Jonah Ezigbo, Onyebuchi Chikezie Nosiri, Ekene Samuel Mbonu, Victor Ofor, and Jude Obichere, "Hand Gesture Recognition and Control for Human-Robot Interaction Using Deep Learning," International Journal of Electrical and Electronic Engineering & Telecommunications, Vol. 12, No. 6, pp. 433-441, November 2023. doi: 10.18178/ijeetc.12.6.433-441

Copyright © 2023 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.