Feature Level Combination for Face Recognition Based on Convolutional Neural Networks
DOI:
https://doi.org/10.29304/jqcm.2021.13.3.849Keywords:
Deep learning, Convolution neural network, Feature combination, Face detection, Face recognitionAbstract
Face detection and recognition systems have recently achieved encouraging results using deep learning, especially Convolutional Neural Network (CNN). Face Recognition (FR) systems have many challenges in unconstrained environments that decrease the accuracy; for overcoming these challenges, a deep learning-based features combination has been proposed. The scheme performs feature-level combination by applying two pre-trained GoogLeNet and VggNet-16 models as deep feature extractors. First, faces are detected and aligned using the Multi-Task Convolutional Neural Networks (MTCNN) face detector. The deep features are extracted from a face image using each individually pre-trained CNN. Second, features obtained from GoogLeNet and VggNet-16 models are combined using the serial-feature combination method. Finally, a classification task is performed using a multiclass Support Vector Machine (SVM) classifier. Experiments on the following datasets: VggFace2, LFW, Essex, and ORL, indicate the efficacy of the proposed system as the combination of the two pre-trained CNN models improves performance. The combination strategy, in particular, yields an accuracy of 95.33% to 99.29% on all datasets. The proposed system was compared to existing models in terms of the LFW, and ORL datasets, the findings showed that the proposed system outperformed most current models in terms of accuracy.
Downloads
References
[2] K. Sundararajan, D.L.Woodard, "Deep learning for biometrics : a survey, ". ACMComput. Surv. 51(3), 2018.
[3] M. Haghighat, S. Zonouz, and M. Abdel-Mottaleb, "CloudID: Trustworthy cloud-based and cross enterprise biometric identification, " Expert Systems with Applications. 42(21): p. 7905-7916, 2015.
[4] M.O. Oloyede, S. Member, G.P. Hancke, "Unimodal and multimodal biometric sensing systems: a review, " IEEE Access 4, 7532–7555,2016.
[5] M. Taskiran, N. Kahraman, and C. E. Erdem, "Face recognition: Past, present and future (a review), "Digit. Signal Process. A Rev. J., vol. 106, p. 102809, 2020.
[6] Y. Kortli, M. Jridi, A. Al Falou, and M. Atri, "Face recognition systems: A survey, "Sensors (Switzerland), vol. 20, no. 2, 2020.
[7] M. Chihaoui, A. Elkefi, W. Bellil, and C. Ben Amar, "A survey of 2D face recognition techniques, "Computers, vol. 5, no. 4, pp. 1–28, 2016.
[8] F. Tabassum, M. Imdadul Islam, R. Tasin Khan, and M. R. Amin, "Human face recognition with combination of DWT and machine learning, "J. King Saud Univ. - Comput. Inf. Sci., no. xxxx, 2020.
[9] S. Bajpai and G. Mishra, "Real Time Face Recognition with limited training data: Feature Transfer Learning integrating CNN and Sparse Approximation, "2021.
[10] Y. X. Yang, C. Wen, K. Xie, F. Q. Wen, G. Q. Sheng, and X. G. Tang, "Face recognition using the SR-CNN model, "Sensors (Switzerland), vol. 18, no. 12, 2018.
[11] J. Li, T. Qiu, C. Wen, K. Xie, and F. Q. Wen, "Robust face recognition using the deep C2D-CNN model based on decision-level fusion, "Sensors (Switzerland), vol. 18, no. 7, pp. 1–27, 2018.
[12] P. Kamencay, M. Benco, T. Mizdos, and R. Radil, "A new method for face recognition using convolutional neural network, "Adv. Electr. Electron. Eng., vol. 15, no. 4 Special Issue, pp. 663–672, 2017.
[13] S. Guo, S. Chen, and Y. Li, "Face recognition based on convolutional neural network & support vector machine, "2016 IEEE Int. Conf. Inf. Autom. IEEE ICIA 2016, no. August, pp. 1787–1792, 2017.
[14] L. Alzubaidi et al., "Review of deep learning: concepts, CNN architectures, challenges, applications, "future directions, vol. 8, no. 1. Springer International Publishing, 2021.
[15] L. Deng and D. Yu, "Deep Learning: Methods and Applications, "Found. Trends® Signal Process., vol. 7, no. 3–4, pp. 197–387, 2014.
[16] P. Kamencay, M. Benco, T. Mizdos, and R. Radil, "A new method for face recognition using convolutional neural network, "Adv. Electr. Electron. Eng., vol. 15, no. 4 Special Issue, pp. 663–672, 2017.
[17] A. Simonyan, Karen and Zisserman, "Very deep convolutional networks for large-scale image recognition, "arXiv Prepr. arXiv1409.1556, 2014.
[18] C. Szegedy, W. Liu, Y. Jia et al., "Going deeper with convolutions, "In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
[19] Q. Cao, L. Shen, W. Xie, O. M. Parkhi, and A. Zisserman, "Vggface2: A dataset for recognizing faces across pose and age," in 2018 13th IEEE, pp. 67-74, 2018, [Online]. Available: https://www.robots.ox.ac.uk/~vgg/data /vgg_face2/. [Accessed: 23-Sept-2020].
[20] G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, "2007, [Online]. “Available: https://hal.inria.fr/inria-00321923. [Accessed:” 18-Sept-2020].
[21] Libor Spacek’s Facial Images Databases “Face 96 Image Database,” [Online]. Available: http://www.cmp.felk.cvut.cz/spacelib/faces/faces96.html. [Accessed: 22-Apr-2020].
[22] "ORL face database, "[Online]. Available: http://www.uk.research.att.com /facedatabase.html. [Accessed: 06-Apr-2020].
[23] S. Turky, A. Ahmed AL-Jumaili, and R. Hasoun, “Deep Learning Based On Different Methods For Text Summary: A Survey”, JQCM, vol. 13, no. 1, pp. Comp Page 26-35, Mar. 2021.
[24] F. Tahir Al-azawi and A. Abdulrahman, “Face Detection By some Methods based on MATLAB”, JQCM, vol. 12, no. 4, pp. Comp Page 12 -17, Nov. 2020.
[25] T. Hameed Obaida, “Face Recognition By Using Nearest Feature Midpoint Algorithm”, JQCM, vol. 9, no. 1, pp. 144-152, Aug. 2017.
[26] Y. Mohammed and E. Saleh, “Investigating the Applicability of Logistic Regression and Artificial Neural Networks in Predicting Breast Cancer”, JQCM, vol. 12, no. 2, pp. Math Page 63-73, Jul. 2020.
[27] N. Jarah, “Deep Learning In Wireless Sensor Network”, JQCM, vol. 13, no. 1, pp. Comp Page 11 -17, Feb. 2021.
