Sign language detection using convolutional neural network for teaching and learning application

Wan Bejuri, Wan Mohd Ya'akob and Syed Ahmad, Sharifah Sakinah and Zakaria, Nur’Ain Najiha and S. M. M Yassin, S. M. Warusia Mohamed and Ngo, Hea Choon and Mohamad, Mohd Murtadha (2022) Sign language detection using convolutional neural network for teaching and learning application. Indonesian Journal of Electrical Engineering and Computer Science, 28 (1). pp. 358-364. ISSN 2502-4752

Text SIGN_LANGUAGE_DETECTION_USING_CONVOLUTIONAL_NEURAL.PDF Download (457kB)

Abstract

Teaching lower school mathematic could be easy for everyone. For teaching in the situation that cannot speak, using sign language is the answer especially someone that have infected with vocal cord infection or critical spasmodic dysphonia or maybe disable people. However, the situation could be difficult, when the sign language is not understandable by the audience. Thus, the purpose of this research is to design a sign language detection scheme for teaching and learning activity. In this research, the image of hand gestures from teacher or presenter will be taken by using a web camera for the system to anticipate and display the image's name. This proposed scheme will detects hand movements and convert it be meaningful information. As a result, it show the model can be the most consistent in term of accuracy and loss compared to others method. Furthermore, the proposed algorithm is expected to contribute the body of knowledge and the society.

Item Type:	Article
Uncontrolled Keywords:	Convolution neural network, Hand gestures, Image processing, ROI, Sign language detection
Divisions:	Faculty of Information and Communication Technology
Depositing User:	Sabariah Ismail
Date Deposited:	02 Mar 2023 12:06
Last Modified:	02 Mar 2023 12:06
URI:	http://eprints.utem.edu.my/id/eprint/26210
Statistic Details:	View Download Statistic

Actions (login required)

View Item