A Sign Language Recognition using Improved Grey Wolf Optimization based neural networks
DOI:
https://doi.org/10.29304/jqcsm.2024.16.31643Keywords:
pattern recognition, Sign language recognition, GWO, Neural networkAbstract
Sign language was developed to enable the deaf and hard of hearing community to communicate with society and convey information. It is the primary means by which they can interact with each other, as well as with the general population. The automatic gesture recognition system described in this paper uses Gray Wolf Optimization (GWO) to identify the most relevant features from a set of gesture images, with the aim of improving model performance. The main steps of the system are explained, including image preprocessing, feature extraction, GWO-based feature selection, classifier training, and evaluation. The proposed model achieved an accuracy of 99.9%.
Downloads
References
A. Sreenivas, “Indian Sign Language Communicator Using Convolutional Neural Network,” Int. J. Adv. Sci. Technol., vol. 29, no. 3, pp. 11015–11031, 2020, [Online]. Available: https://www.researchgate.net/publication/343263135_Indian_Sign_Language_Communicator_Using_Convolutional_Neural_Network
M. Xing, J. Hu, Z. Feng, Y. Su, W. Peng, and J. Zheng, “Dynamic hand gesture recognition using motion pattern and shape descriptors,” Multimed. Tools Appl., vol. 78, no. 8, pp. 10649–10672, Apr. 2019, doi: 10.1007/s11042-018-6553-9.
A. H. Alrubayi et al., “A pattern recognition model for static gestures in malaysian sign language based on machine learning techniques,” Comput. Electr. Eng., vol. 95, Oct. 2021, doi: 10.1016/j.compeleceng.2021.107383.
S. R. Bansal, S. Wadhawan, and R. Goel, “mRMR-PSO: A Hybrid Feature Selection Technique with a Multiobjective Approach for Sign Language Recognition,” Arab. J. Sci. Eng., vol. 47, no. 8, pp. 10365–10380, Aug. 2022, doi: 10.1007/s13369-021-06456-z.
J. Singhai, S. Gupta, Maulana Azad National Institute of Technology, IEEE Asia-Pacific Region. MP Subsection, IEEE Asia-Pacific Region. Bombay Section, and Institute of Electrical and Electronics Engineers, 2018 IEEE International Students’ Conference on Electrical, Electronics and Computer Science (SCEECS) : February 24-25, 2018, Maulana Azad National Institute of Technology, Bhopal.
A. Thongtawee, O. Pinsanoh, and Y. Kitjaidure, “A Novel Feature Extraction for American Sign Language Recognition Using Webcam,” BMEiCON 2018 - 11th Biomed. Eng. Int. Conf., pp. 1–5, 2019, doi: 10.1109/BMEiCON.2018.8609933.
M. M. Kamruzzaman, “Arabic Sign Language Recognition and Generating Arabic Speech Using Convolutional Neural Network,” Wirel. Commun. Mob. Comput., vol. 2020, 2020, doi: 10.1155/2020/3685614.
J. Shin, A. Matsuoka, M. A. M. Hasan, and A. Y. Srizon, “American sign language alphabet recognition by extracting feature from hand pose estimation,” Sensors, vol. 21, no. 17, Sep. 2021, doi: 10.3390/s21175856.
R. G. Rajan, P. S. Rajendran, J. Mulerikkal, and R. Surendiran, “Automatic Detection of Sign Language Fingerspelling on Combined Features and Feature Selection using Improvised Battle Royale Optimisation Algorithm,” SSRG Int. J. Electr. Electron. Eng., vol. 10, no. 5, pp. 69–78, 2023, doi: 10.14445/23488379/IJEEE-V10I5P107.
M. M. Damaneh, F. Mohanna, and P. Jafari, “Static hand gesture recognition in sign language based on convolutional neural network with feature extraction method using ORB descriptor and Gabor filter,” Expert Syst. Appl., vol. 211, Jan. 2023, doi: 10.1016/j.eswa.2022.118559.
R. K. Pathan, M. Biswas, S. Yasmin, M. U. Khandaker, M. Salman, and A. A. F. Youssef, “Sign language recognition using the fusion of image and hand landmarks through multi-headed convolutional neural network,” Sci. Rep., vol. 13, no. 1, Dec. 2023, doi: 10.1038/s41598-023-43852-x.
J. Wang, D. Lin, Y. Zhang, and S. Huang, “An adaptively balanced grey wolf optimization algorithm for feature selection on high-dimensional classification,” Eng. Appl. Artif. Intell., vol. 114, Sep. 2022, doi: 10.1016/j.engappai.2022.105088.
N. Paharia, R. S. Jadon, and S. K. Gupta, “Optimization of convolutional neural network hyperparameters using improved competitive gray wolf optimizer for recognition of static signs of Indian Sign Language,” J. Electron. Imaging, vol. 32, no. 02, Apr. 2023, doi: 10.1117/1.jei.32.2.023042.
R. M. Abdulhamied, M. M. Nasr, and S. N. Abdulkader, “Real-time recognition of American sign language using long-short term memory neural network and hand detection,” Indones. J. Electr. Eng. Comput. Sci., vol. 30, no. 1, pp. 545–556, 2023, doi: 10.11591/ijeecs.v30.i1.pp545-556.
A. N. Kumar and G. Geetha, “Recognizing Ancient South Indian Language Using Opposition Based Grey Wolf Optimization,” Intell. Autom. Soft Comput., vol. 35, no. 3, pp. 2619–2637, 2023, doi: 10.32604/iasc.2023.028349.
J. Zupan, “Introduction to Artificial Neural Network ( ANN ) Methods : What They Are and How to Use Them *.,” no. September, pp. 327–352, 1994.
E. Aldhahri et al., “Arabic Sign Language Recognition Using Convolutional Neural Network and MobileNet,” Arab. J. Sci. Eng., vol. 48, no. 2, pp. 2147–2154, Feb. 2023, doi: 10.1007/s13369-022-07144-2.
J. Fregoso, C. I. Gonzalez, and G. E. Martinez, “Optimization of convolutional neural networks architectures using pso for sign language recognition,” Axioms, vol. 10, no. 3, 2021, doi: 10.3390/axioms10030139.
T. Kujani and V. Dhilipkumar, “Multiple Deep CNN models for Indian Sign Language translation for Person with Verbal Impairment,” Int. J. Intell. Syst. Appl. Eng., vol. 10, no. 3, pp. 382–389, 2022.
B. M. Gunji, N. M. Bhargav, A. Dey, I. K. Zeeshan Mohammed, and S. Sathyajith, “Recognition of Sign Language Based on Hand Gestures,” J. Adv. Appl. Comput. Math., vol. 8, pp. 21–32, 2022, doi: 10.15377/2409-5761.2021.08.3
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Zahraa A. Hussein, Qusay O. Mosa, Alaa H. Hammadi
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
