Automated Binary Classification of Diabetic Retinopathy by SWIN Transformer
DOI:
https://doi.org/10.29304/jqcm.2023.15.1.1166Keywords:
Diabetic retinopathy, Swin transformer, Gaussian, APTOS, CLAHEAbstract
Diabetic retinopathy is a medical condition that affects the eyes and is caused by damage to the blood vessels in the retina (the light-sensitive part of the eye) due to high blood sugar levels in individuals with diabetes. This damage can lead to vision loss or even blindness. It is a common complication of diabetes and a leading cause of blindness in working-age adults. In this paper, to automatically classify images of the retina as having either diabetic retinopathy or not. The goal of this classification is to assist medical professionals in diagnosing diabetic retinopathy more accurately and efficiently, potentially improving patient outcomes. In this process, the Swin transformer model is trained on the APTOS dataset of retinal images and then used to automatically classify new images as either positive or negative for diabetic retinopathy. Used CLAHE and Gaussian, to improve the input image, and the model achieved a Test Accuracy of 96%, Sensitivity of 96%, F1 Score of 96% for Swin-T and Test Accuracy of 98% for Swin-B, Sensitivity of 98%, and F1 Score of 98%.
Downloads
References
[2] T. Nazir, M. Nawaz, J. Rashid, and R. Mahum, “Detection of Diabetic Eye Disease from Retinal Images Using a Deep Learning Based CenterNet Model Tahira,” MDPI, vol. 21, no. 5283, 2021.
[3] Z. Liu, Y. Lin, Y. Cao, H. Hu, and Y. Wei, “Swin Transformer: Hierarchical Vision Transformer using Shifted Windows arXiv:2103.14030v2,” arXiv:2103.14030v2, 2021.
[4] J. Liang, J. Cao, G. Sun, and K. Zhang, “SwinIR: Image Restoration Using Swin Transformer,” arXiv:2108.10257v1, 2021.
[5] S. Sanjana, N. S. Shadin, and M. Farzana, “Automated Diabetic Retinopathy Detection Using Transfer Learning Models,” 2021.
[6] Y. Li, Z. Song, S. Kang, S. Jung, and W. Kang, “Semi-Supervised Auto-Encoder Graph Network for Diabetic Retinopathy Grading,” IEEE Access, vol. 9, pp. 140759–140767, 2021, doi: 10.1109/ACCESS.2021.3119434.
[7] S. Gungor Koba, N. Baygin, E. Yusufoglu, and M. Baygin, “Automated Diabetic Retinopathy Detection Using Horizontal and Vertical Patch Division-Based Pre-Trained DenseNET with Digital Fundus Images,” MDPI, 2022.
[8] D. Chen, W. Yang, L. Wang, S. Tan, J. Lin, and W. Bu, “PCAT-UNet: UNet-like network fused convolution and transformer for retinal vessel segmentation,” PLoS ONE, vol. 17, no. 1 1. 2022, doi: 10.1371/journal.pone.0262689.
[9] S. Hao, B. Wu, K. Zhao, and Y. Ye, “Two-Stream Swin Transformer with Differentiable Sobel Operator for Remote Sensing Image Classification,” Remote Sens., 2022.
[10] R. Fan, X. Li, S. Lee, and T. Li, “Smart Image Enhancement Using CLAHE Based on an F-Shift Transformation during Decompression,” MDPI, vol. 12, no. 1374, 2020.
[11] B. Tymchenko, P. Marchenko, and D. Spodarets, “Deep Learning Approach to Diabetic Retinopathy Detection Borys,” arXiv:2003.02261v1, 2020.
[12] R. S. R, “Design an Early Detection and Classification for Diabetic Retinopathy by Deep Feature Extraction based Convolution Neural Network,” J. Trends Comput. Sci. Smart Technol., vol. 3, no. 2, 2021.
[13] C.-Y. Tsai, C.-T. Chen, G.-A. Chen, and C.-T. K. Kuo, “Necessity of Local Modification for Deep Learning Algorithms to Predict Diabetic Retinopathy Ching-Yao,” Int. J. Environ. Res. Public Health, 2022.