Supporting Patients of Age-related Macular Degeneration in Malaysia using Mobile Application enabled with Object and Text Recognition
DOI:
https://doi.org/10.56532/mjsat.v4i4.364Keywords:
Age-relate Macular Degeneration, Mobile Application, Object Recognition, Text RecognitionAbstract
Patients contracting Age-related Macular Degeneration (AMD) disease cannot properly recognize objects or text through their central vision. After literature reviewed, there is still lack of empirical study how lightweight mobile application, operates without Internet but with object and text recognition capability can help Malaysian AMD patients to see better. This research developed a simple yet useful mobile application using Kotlin Programming and Android Studio with object and text recognition capability to generate audio speech for patients to perceive and understand better. The application yields average precision (mAP) of 42% for object recognition and 83% for text recognition. Despite lower mAP for object recognition, through Unit and Usability Testing conducted on AMD patients, the test results met the requirements and the application successfully supported them to have a better grasp of their surroundings. This research contributed a small step in relieving Malaysian AMD patients to see better and live more independently. Limitations and future improvements were also provided.
References
Lombardo, M., Serrao, S., & Lombardo, G. (2022) Challenges in Age-Related Macular Degeneration: From Risk Factors to Novel Diagnostics and Prevention Strategies. Front. Med. 9:887104. doi: 10.3389/fmed.2022.887104.
Perski, T. (2022, October 27). Eccentric Viewing; Vision Rehabilitation for People with AMD. https://medium.com/@tomperski/eccentric-viewing-vision-rehabilitation-for-people-with-amd-184014e81764
Moshfeghi, A. A., Lanitis, T., Kropat, G., Kuznik, A., Gibson, A., Feng, H. et al. (2020). Social cost of blindness due to AMD and diabetic retinopathy in the United States in 2020. Ophthalmic Surg Lasers Imaging Retina. 51:S6-14. doi: 10.3928/23258160-20200401-01.
Jeffery R. C. H., Mukhtar, S. A., Lopez, D., Preen, D. B., McAllister, I. L., Mackey, D. A., et al. (2021). Incident of newly registered blindness from age-related macular degeneration in Australia over a 21-year period: 1996-2016. Asia Pac J Ophthalmol. 10:442-9.
Macnamara, A., Chen, C. S., Davies, A., Sloan, C., & Loetscher, T. (2021). Low vision devices for age-related macular degeneration: a systematic review. Disability and Rehabilitation: Assistive Technology, 18(7), 998–1010. https://doi.org/10.1080/17483107.2021.1966523.
Wang, J., Wang, S., & Zhang, Y. (2023). Artificial intelligence for visually impaired. Elsevier, Displays 77 (2023) 102391. https://doi.org/10.1016/j.displa.2023.102391.
Honavar, S. G. (2023). Eye of the AI storm: Exploring the impact of AI tools in ophthalmology. Indian Journal of Ophthalmology 71(6):p 2328-2340, June 2023. | DOI: 10.4103/IJO.IJO_1478_23.
Bali, J., & Bali, O. (2023). Eyes of the Future: A Comprehensive Mapping of the Evolving Landscape of Artificial Intelligence in Ophthalmology. Delhi Journal of Ophthalmology 33(3):p 237-245, Jul–Sep 2023. | DOI: 10.4103/DLJO.DLJO_135_23.
Leonard, V. K., Jacko, J. A., & Pizzimenti, J. J. (2006). An investigation of handheld device use by older adults with age-related macular degeneration. Behaviour & Information Technology, 25(4), 313–332. https://doi.org/10.1080/01449290600636512.
Hakobyan, L., Lumsden, J., O'Sullivan, D., & Bartlett, H. (2012). Understanding the IT-related attitudes and needs of persons with age-related macular degeneration: a case study. IN: Proceedings of BCS HCI 2012 - People and Computers XXVI. GBR: UNSPECIFIED.
Reeves, B. C., Wickens, R., O’Connor, S. R., Gidman, E. A., Ward, E., Treanor, C., ... & Hogg, R. E. (2024). Descriptive study of the challenges when implementing an app for patients with neovascular age-related macular degeneration to monitor their vision at home. BMJ open, 14(3), e077196.
Lavric, A., Beguni, C., Zadobrischi, E., Cailean A., Avatamanitei, S. (2024). A Comprehensive Survey on Emerging Assistive Technologies for Visually Impaired Persons: Lighting the Path with Visible Light Communications and Artificial Intelligence Innovations. Sensors 2024, 24, 4834.
StatCounter Global Stats. (2024, August 4). Mobile Operating System Market Share Malaysia. https://gs.statcounter.com/os-market-share/mobile/malaysia.
Akkara, J. D., Kuriakose, A. (2019). Role of Artificial Intelligence and Machine Learning in Ophthalmology. Kerala Journal Ophthalmology, Volume 31, Issue 2, May-August 2019, 150-160. DOI: 10.4103/kjo.kjo_54_19.
Hwang, D. K., Hsu, C. C., Chang, K. J., Chao, D., Sun, C. H., Jheng, Y. C., ... & Chiou, S. H. (2019). Artificial intelligence-based decision-making for age-related macular degeneration. Theranostics, 9(1), 232.
Romond, K., Alam, M., Kravets, S., Sisternes, L. D., Leng, T., Lim, J. I., ... & Hallak, J. A. (2021). Imaging and artificial intelligence for progression of age-related macular degeneration. Experimental Biology and Medicine, 246(20), 2159-2169.
Lin, Y. (2023, January 26). 10 Mobile Usage Statistics Every Marketer Should Know in 2023. Oberlo. https://www.oberlo.com/blog/mobile-usage-statistics#:~:text=There%20are%206.8%20billion%20smartphone,approach%20an%20in%2Dstore%20employee.
Ud Din Arshad, Q. K., Kashif, A. U., & Quershi, I. M. (2019, January 8-12). A review on the evolution of cellular technologies [Paper presentation]. Proceedings of 2019 16th International Bhurban Conference on Applied Sciences & Technology (IBCAST), Islamabad, Pakistan.
TensorFlow. (2022, September 3). TensorFlow Lite for Android. https://www.tensorflow.org/lite/android.
Hisham, Z. A. N., Faudzi, M. A., Ghapar, A. A., & Rahim, F. A. (2020, August 24-26). A systematic literature review of the mobile application for object recognition for visually impaired people [Paper presentation]. 2020 8th International Conference on Information Technology and Multimedia (ICIMU), Selangor, Malaysia.
Nasir, H. M., Brahin, N. M. A., Aminuddin, M. M. M., Mispan, M. S., & Zulkifli, M. F. (2021). Android based application for visually impaired using deep learning approach. IAES International Journal of Artificial Intelligence (IJ-AI), 10(4), 879-888. https://doi.org/10.11591/ijai.v10.i4.pp879-888.
Salunkhe, A., Raut, M., Santra, S., & Bhagwar, S. (2021). Android-based object recognition application for visually impaired. ITM Web of Conferences, 40, Article 03001. https://doi.org/10.1051/itmconf/20214003001.
Martinez-Alpiste, I., Golcarenarenji, G., Wang, Q., & Alcaraz-Calero, J. M. (2022). Smartphone-based real-time object recognition architecture for portable and constrained systems. Journal of Real-Time Image Processing, 19, 103-113. https://doi.org/10.1007/s11554-021-01164-1.
Jia, J., Fu, M., Liu, X., & Zheng, B. (2022). Underwater object detection based on improved EfficientDet. Remote Sensing, 14(18), Article 4487. https://doi.org/10.3390/rs14184487.
Gonçalves, M. P. (2022). MLKit Text Recognition Evaluation.
Charishma, K., Umar, M., Chettri, R., Singh, R. K., Hussain, T., & Ravindranath, R. (2021). Review of Android Based Portable Sign and Text Recognition System. International Journal of AH Research Education and Scientific Methods (IJARESM), ISSN: 2455-6211 Volume 9, Issue 5, May -2021, Impact Factor: 7.429.
Boesch, G. (2022, July 9). LabelImg for Image Annotation. Viso. https://viso.ai/computer-vision/labelimg-for-image-annotation/#:~:text=LabelImg%20is%20a%20lightweight%20and,success%20of%20computer%20vision%20applications.
Góis Mateus, B., & Martinez, M. (2019). An empirical study on quality of Android applications written in Kotlin language. Empirical Software Engineering, 24(6), 3356-3393.
Saabith, A. S., Fareez, M. M. M., & Vinothraj, T. (2019). Python current trend applications-an overview. International Journal of Advance Engineering and Research Development, 6(10).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Han Ping Fung
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
