E2ETCA: End-to-end training of CNN and attention ensembles for rice disease diagnosis

doi:10.1016/j.jia.2024.03.075

Journal of Integrative Agriculture

Advanced Online Publication | Current Issue | Archive | Adv Search

Md. Zasim Uddin^1#, Md. Nadim Mahamood¹, Ausrukona Ray¹, Md. Ileas Pramanik¹, Fady Alnajjar^2#, Md Atiqur Rahman Ahad³

¹Department of Computer Science and Engineering, Begum Rokeya University, Rangpur, Bangladesh

²Department of Computer Science and Software Engineering, United Arab Emirates University, UAE

³Department of Computer Science and Digital Technologies, University of East London, London, UK

Abstract
References

Download: PDF in ScienceDirect
Export: BibTeX | EndNote (RIS)

Abstract Rice is one of the most important crops worldwide. Diseases of the rice plant can drastically reduce crop yield and even lead to complete loss of production. Early diagnosis can reduce the severity and help efforts to establish effective treatment and reduce the usage of pesticides. Traditional machine learning approaches have already been employed for automatic diagnosis. However, they heavily rely on manual preprocessing of images and handcrafted features, which is challenging, time-consuming, and may require domain expertise. Recently, a single end-to-end deep learning (DL)-based approach was employed to diagnose rice diseases. However, it is not highly robust, nor is it generalizable to every dataset. Hence, we propose a novel end-to-end training of convolutional neural network (CNN) and attention (E2ETCA) ensemble framework that fuses the features of two CNN-based state-of-the-art (SOTA) models along with those of an attention-based vision transformer model. These fused features are utilized for diagnosis by the addition of an extra fully connected layer with softmax. The whole procedure is performed end-to-end, which is very important for real-world applications. Additionally, we feed the extracted features into a traditional machine learning approach support vector machine for classification and further analysis. To verify the effectiveness of our proposed E2ETCA framework, we demonstrate it on three publicly available datasets: the Mendeley Rice Leaf Disease Image Samples dataset, the Kaggle Rice Diseases Image dataset, the Bangladesh Rice Research Institute dataset, and a combination of these three datasets. On the basis of various evaluation metrics (accuracy, precision, recall, and F1-score), our proposed E2ETCA framework exhibits superior performance to existing SOTA approaches for rice disease diagnosis, which can also be generalizable in similar other domains.

Keywords: Rice disease diagnosis Ensemble method CNN-based model End-to-end model Inception model DenseNet model Vision transformer model Attention-based model Support vector machine

Online: 24 April 2024

Fund: We are grateful to the Begum Rokeya University, Rangpur, and the United Arab Emirates University for partially supporting this work.

About author: #Correspondence Md. Zasim Uddin, E-mail: zasim@brur.ac.bd; Fady Alnajjar, E-mail:fady.alnajjar@uaeu.ac.ae

	Service
	E-mail this article
	Add to citation manager
	E-mail Alert
	RSS

	Articles by authors

Cite this article:

Md. Zasim Uddin, Md. Nadim Mahamood, Ausrukona Ray, Md. Ileas Pramanik, Fady Alnajjar, Md Atiqur Rahman Ahad. 2024. E2ETCA: End-to-end training of CNN and attention ensembles for rice disease diagnosis. Journal of Integrative Agriculture, Doi:10.1016/j.jia.2024.03.075

Agrios, G., 2005. Plant pathology 5th edition: Elsevier academic press. Burlington, Ma. USA , 79–103.

Agustin, M., Hermawan, I., Arnaldy, D., Muharram, A.T., Warsuta, B., 2023. Design of livestream video system and classification of rice disease. JOIV: International Journal on Informatics Visualization 7, 139–145.

Ahad, M.T., Li, Y., Song, B., Bhuiyan, T., 2023. Comparison of cnn-based deep learning architectures for rice diseases classification. Artificial Intelligence in Agriculture 9, 22–35.

Ahmed, K., Shahidi, T.R., Alam, S.M.I., Momen, S., 2019. Rice leaf disease detection using machine learning techniques, in 2019 International Conference on Sustainable Technologies for Industry 4.0 (STI), IEEE. pp. 1–5.

Al-Gaashani, M.S., Samee, N.A., Alnashwan, R., Khayyat, M., Muthanna, M.S.A., 2023. Using a resnet50 with a kernel attention mechanism for rice disease diagnosis. Life 13, 1277.

Andrianto, H., Faizal, A., Armandika, F., et al., 2020. Smartphone application for deep learning-based rice plant disease detection, in 2020 international conference on information technology systems and innovation (ICITSI), IEEE. pp. 387–392.

Anwar, S.M., Majid, M., Qayyum, A., Awais, M., Alnowami, M., Khan, M.K., 2018. Medical image analysis using convolutional neural networks: a review. Journal of medical systems 42, 1–13.

Bejani, M.M., Ghatee, M., 2021. A systematic review on overfitting control in shallow and deep neural networks. Artificial Intelligence Review, 1–48.

Bhartiya, V.P., Janghel, R.R., Rathore, Y.K., 2022. Rice leaf disease prediction using machine learning, in 2022 Second International Conference on Power, Control and Computing Technologies (ICPC2T), IEEE. pp. 1–5.

Borhani, Y., Khoramdel, J., Najafi, E., 2022. A deep learning based approach for automated plant disease classification using vision transformer. Scientific Reports 12, 11554.

Caruana, R., Niculescu-Mizil, A., Crew, G., Ksikes, A., 2004. Ensemble selection from libraries of models, in: Proceedings of the twenty-first international conference on Machine learning, p. 18.

David, T., Alfred, R., Obit, J.H., Fui, F.S., Gobilik, J., Iswandono, Z., Haviluddin, H., 2022. Optimization of convolutional neural network in paddy disease detection, in: International Conference on Computational Science and Technology, pp. 399–412.

Deng, R., Tao, M., Xing, H., Yang, X., Liu, C., Liao, K., Qi, L., 2021. Automatic diagnosis of rice diseases using deep learning. Frontiers in Plant Science 12, 701038.

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al., 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929.

Durmus¸, H., Gu¨nes¸, E.O., Kırcı, M., 2017. Disease detection on the leaves of the tomato plants by using deep learning, in: 2017 6th International conference on agro-geoinformatics, IEEE. pp. 1–5.

Gautam, V., Trivedi, N.K., Singh, A., Mohamed, H.G., Noya, I.D., Kaur, P., Goyal, N., 2022. A transfer learning-based artificial intelligence model for leaf disease assessment. Sustainability 14, 13610.

Ghosal, S., Sarkar, K., 2020. Rice leaf diseases classification using cnn with transfer learning, in 2020 IEEE Calcutta Conference (CALCON), IEEE. pp. 230–236.

Hassan, S.M., Maji, A.K., 2022. Plant disease identification using a novel convolutional neural network. IEEE Access 10, 5390–5401.

Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q., 2017. Densely connected convolutional networks, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4700–4708.

Islam, T., Sah, M., Baral, S., Choudhury, R.R., 2018. A faster technique on rice disease detectionusing image processing of affected area in agro-field, in 2018 Second International Conference on Inventive Communication and Computational Technologies (ICI-CCT), IEEE. pp. 62–66.

Jiang, F., Lu, Y., Chen, Y., Cai, D., & Li, G. (2020). Image recognition of four rice leaf diseases based on deep learning and support vector machine. Computers and Electronics in Agriculture, 179, 105824.

Joshi, A. A., & Jadhav, B. D. (2016). Monitoring and controlling rice diseases using Image processing techniques. In 2016 International Conference on Computing, Analytics and Security Trends (CAST) (pp. 471-476). IEEE.

Kathiresan, G., Anirudh, M., Nagharjun, M., & Karthik, R. (2021, May). Disease detection in rice leaves using transfer learning techniques. In: Journal of Physics: Conference Series (Vol. 1911, No. 1, p. 012004). IOP Publishing.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25.

Kumar K, K., E, K., 2022. Detection of rice plant disease using adaboost svm classifier. Agronomy journal 114, 2213–2229.

Liao, F.b., FENG, X.q., LI, Z.q., WANG, D.y., XU, C.m., Guang,

C., Qing, Y., Song, C., et al., 2023. A hybrid cnn-lstm model for diagnosing rice nutrient levels at the rice panicle initiation stage. Journal of Integrative Agriculture.

Lu, Y., Yi, S., Zeng, N., Liu, Y., Zhang, Y., 2017. Identification of rice diseases using deep convolutional neural networks. Neurocomput ing 267, 378–384.

Mohammed, A., Kora, R., 2023. A comprehensive review on ensemble deep learning: Opportunities and challenges. Journal of King Saud University-Computer and Information Sciences.

Nalini, S., Krishnaraj, N., Jayasankar, T., Vinothkumar, K., Britto, A. S. F., Subramaniam, K., & Bharatiraja, C. (2021). Paddy leaf disease detection using an optimized deep neural network. Computers, Materials & Continua, 68(1), 1117-1128.

Opitz, D., Maclin, R., 1999. Popular ensemble methods: An empirical study. Journal of artificial intelligence research 11, 169–198.

Paymode, A.S., Malode, V.B., 2022. Transfer learning for multi-crop leaf disease image classification using convolutional neural network vgg. Artificial Intelligence in Agriculture 6, 23–33.

Peng, J., Wang, Y., Jiang, P., Zhang, R., Chen, H., 2023. Ricedranet: Precise identification of rice leaf diseases with complex back grounds using a res-attention mechanism. Applied Sciences13, 4928.

Peng, S., Tang, Q., Zou, Y., 2009. Current status and challenges of rice production in china. Plant Production Science 12, 3–8.

Phadikar, S., Sil, J., Das, A.K., 2012. Classification of rice leaf diseases based on morphological changes. International Journal of Information and Electronics Engineering 2, 460–463.

Putra, O.V., Ningrum, N.T., Puspitasari, N.S., Wibowo, A.T., Rachmawaty, E., 2022. Hit-lidia: A framework for rice leaf disease classification using ensemble and hierarchical transfer learning. Lontar Komputer: Jurnal Ilmiah Teknologi Informasi 13, 196.

Rahman, C.R., Arko, P.S., Ali, M.E., Khan, M.A.I., Apon, S.H., Nowrin, F., Wasif, A., 2020. Identification and recognition of rice diseases and pests using convolutional neural networks. Biosystems Engineering 194, 112–120.

Ramesh, S., Vydeki, D., 2020. Recognition and classification of paddy leaf diseases using optimized deep neural network with jaya algorithm. Information processing in agriculture 7, 249–260.

Sanghvi, H.A., Patel, R.H., Agarwal, A., Gupta, S., Sawhney, V., Pandya, A.S., 2023. A deep learning approach for classification of covid and pneumonia using densenet-201. International Journal of Imaging Systems and Technology 33, 18–38.

Serbetci, A., Akgul, Y.S., 2020. End-to-end training of cnn ensembles for person re-identification. Pattern Recognition 104, 107319.

Sethy, P.K., Barpanda, N.K., Rath, A.K., Behera, S.K., 2020. Image processing techniques for diagnosing rice plant disease: a survey. Procedia Computer Science 167, 516–530.

Shahbandeh, M., 2023. Global rice consumption 2022/23, by country.

Sharma, M., Kumar, C. J., & Deka, A. (2022). Early diagnosis of rice plant disease using machine learning techniques. Archives of Phytopathology and Plant Protection, 55(3), 259-283.

Sharma, M., Nath, K., Sharma, R.K., Kumar, C.J., Chaudhary, A., 2022b. Ensemble averaging of transfer learning models for identification of nutritional deficiency in rice plant. Electronics 11, 148.

Sharma, R., Singh, A., Jhanjhi, N., Masud, M., Jaha, E.S., Verma, S., et al., 2022c. Plant disease diagnosis and image classification using deep learning. Computers, Materials & Continua 71.

Simhadri, C.G., Kondaveeti, H.K., 2023. Automatic recognition of rice leaf diseases using transfer learning. Agronomy 13, 961.

Singh, S.P., Pritamdas, K., Devi, K.J., Devi, S.D., 2023. Custom convolutional neural network for detection and classification of rice plant diseases. Procedia Computer Science 218, 2026–2040.

Stephen, A., Punitha, A., Chandrasekar, A., 2023. Optimal deep generative adversarial network and convolutional neural network for rice leaf disease prediction. The Visual Computer, 1–18.

Strange, R.N., Scott, P.R., 2005. Plant disease: a threat to global food security. Annu. Rev. Phytopathol. 43, 83–116.

Sudhesh, K., Sowmya, V., Kurian, S., Sikha, O., 2023. Ai based rice leaf disease identification enhanced by dynamic mode decomposition. Engineering Applications of Artificial Intelligence 120, 105836.

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., 2015. Going deeper with convolutions, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1–9.

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z., 2016. Rethinking the inception architecture for computer vision, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2818–2826.

Talukder, M.S.H., Sarkar, A.K., 2023. Nutrients deficiency diagnosis of rice crop by weighted average ensemble learning. Smart Agricultural Technology 4, 100155.

Temniranrat, P., Kiratiratanapruk, K., Kitvimonrat, A., Sinthupinyo, W., Patarapuwadol, S., 2021. A system for automatic rice disease detection from rice paddy images serviced via a chatbot. Computers and Electronics in Agriculture 185, 106156.

Turkoglu, M., Yanikog˘lu, B., Hanbay, D., 2022. Plantdiseasenet: Convolutional neural network ensemble for plant disease and pest detection. Signal, Image and Video Processing 16, 301–309.

Udayananda, G., Shyalika, C., Kumara, P., 2022. Rice plant disease diagnosing using machine learning techniques: a comprehensive review. SN Applied Sciences 4, 311.

Uddin, M.Z., Muramatsu, D., Takemura, N., Ahad, M.A.R., Yagi, Y., 2019. Spatio-temporal silhouette sequence reconstruction for gait recognition against occlusion. IPSJ Transactions on Computer Vision and Applications 11, 1–18.

Uddin, M.Z., Ngo, T.T., Makihara, Y., Takemura, N., Li, X., Muramatsu, D., Yagi, Y., 2018. The ou-isir large population gait database with real-life carried object and its performance evaluation. IPSJ Transactions on Computer Vision and Applications 10, 1–11.

Van Ho, S., Vuong, H.G., Nguyen, B.Q., Trinh, Q.H., Tran, M.T., 2022. Ensemble of deep neural networks for rice leaf disease classification, in: 2022 RIVF International Conference on Computing and Communication Technologies (RIVF), IEEE. pp. 238–243.

Wang, Y., Wang, H., Peng, Z., 2021. Rice diseases detection and classification using attention based neural network and bayesian optimization. Expert Systems with Applications 178, 114770.

Zeng, N., Gong, G., Zhou, G., Hu, C., 2023. An accurate classification of rice diseases based on icai-v4. Plants 12, 2225.

Zhang, J., Fukuda, T., Yabuki, N., 2021. Automatic object removal with obstructed fac¸ades completion using semantic segmentation and generative adversarial inpainting. IEEE Access 9, 117486– 117495.

Zhang, Y., Zhong, L., Ding, Y., Yu, H., Zhai, Z., 2023. Resvit-rice: A deep learning model combining residual module and transformer encoder for accurate detection of rice diseases. Agriculture 13, 126

[1]	Dong Deng, Wenqi Wu, Canxing Duan, Suli Sun, Zhendong Zhu. *A novel pathogen Fusarium* cuneirostrum causing common bean (Phaseolus vulgaris) root rot in China** [J]. >Journal of Integrative Agriculture, 2024, 23(1): 166-176.
[2]	Mu Zeng, Binhu Wang, Lei Liu, Yalan Yang, Zhonglin Tang. Genome-wide association study identifies 12 new genetic loci associated with growth traits in pigs[J]. >Journal of Integrative Agriculture, 2024, 23(1): 217-227.
[3]	Jie Cheng, Xiukai Cao, Shengxuan Wang, Jiaqiang Zhang, Binglin Yue, Xiaoyan Zhang, Yongzhen Huang, Xianyong Lan, Gang Ren, Hong Chen. 3D genome organization and its study in livestock breeding[J]. >Journal of Integrative Agriculture, 2024, 23(1): 39-58.
[4]	Xiaotong Guo, Xiangju Li, Zheng Li, Licun Peng, Jingchao Chen, Haiyan Yu, Hailan Cui. *Effect of mutations on acetohydroxyacid synthase (AHAS) function in Cyperus* difformis L.**[J]. >Journal of Integrative Agriculture, 2024, 23(1): 177-186.
[5]	Simin Liao, Zhibin Xu, Xiaoli Fan, Qiang Zhou, Xiaofeng Liu, Cheng Jiang, Liangen Chen, Dian Lin, Bo Feng, Tao Wang. *Genetic dissection and validation of a major QTL for grain weight on chromosome 3B in bread wheat (Triticum* aestivum L.)** [J]. >Journal of Integrative Agriculture, 2024, 23(1): 77-92.
[6]	Yanan Xu, Yue Wu, Yan Han, Jiqing Song, Wenying Zhang, Wei Han, Binhui Liu, Wenbo Bai. Effect of chemical regulators on the recovery of leaf physiology, dry matter accumulation and translocation, and yield-related characteristics in winter wheat following dry-hot wind[J]. >Journal of Integrative Agriculture, 2024, 23(1): 108-121.
[7]	Tingcheng Zhao, Aibin He, Mohammad Nauman Khan, Qi Yin, Shaokun Song, Lixiao Nie. Coupling of reduced inorganic fertilizer with plant-based organic fertilizer as a promising fertilizer management strategy for colored rice in tropical regions [J]. >Journal of Integrative Agriculture, 2024, 23(1): 93-107.
[8]	Atiqur RAHMAN, Md. Hasan Sofiur RAHMAN, Md. Shakil UDDIN, Naima SULTANA, Shirin AKHTER, Ujjal Kumar NATH, Shamsun Nahar BEGUM, Md. Mazadul ISLAM, Afroz NAZNIN, Md. Nurul AMIN, Sharif AHMED, Akbar HOSAIN. Advances in DNA methylation and its role in cytoplasmic male sterility in higher plants[J]. >Journal of Integrative Agriculture, 2024, 23(1): 1-19.
[9]	Jingui Wei, Qiang Chai, Wen Yin, Hong Fan, Yao Guo, Falong Hu, Zhilong Fan, Qiming Wang. Grain yield and N uptake of maize in response to increased plant density under reduced water and nitrogen supply conditions[J]. >Journal of Integrative Agriculture, 2024, 23(1): 122-140.
[10]	Wan Wang, Zhenjiang Zhang, Weldu Tesfagaber, Jiwen Zhang, Fang Li, Encheng Sun, Lijie Tang, Zhigao Bu, Yuanmao Zhu, Dongming Zhao. Establishment of an indirect immunofluorescence assay for the detection of African swine fever virus antibodies[J]. >Journal of Integrative Agriculture, 2024, 23(1): 228-238.
[11]	Yanfei Song, Tai’an Tian, Yichai Chen, Keshi Zhang, Maofa Yang, Jianfeng Liu. A mite parasitoid, Pyemotes zhonghuajia, negatively impacts the fitness traits and immune response of the fall armyworm, Spodoptera frugiperda[J]. >Journal of Integrative Agriculture, 2024, 23(1): 205-216.
[12]	Qi Zhang, Wenqin Zhan, Chao Li, Ling Chang, Yi Dong, Jiang Zhang. *Host-induced silencing of MpPar6* confers Myzus persicae resistance in transgenic rape plants** [J]. >Journal of Integrative Agriculture, 2024, 23(1): 187-194.
[13]	Jie Xue, Xianglin Zhang, Songchao Chen, Bifeng Hu, Nan Wang, Zhou Shi. Quantifying the agreement and accuracy characteristics of four satellite-based LULC products for cropland classification in China [J]. >Journal of Integrative Agriculture, 2024, 23(1): 283-297.
[14]	Qiuyan Yan, Linjia Wu, Fei Dong, Shuangdui Yan, Feng Li, Yaqin Jia, Jiancheng Zhang, Ruifu Zhang, Xiao Huang. Subsoil tillage enhances wheat productivity, soil organic carbon and available nutrient status in dryland fields [J]. >Journal of Integrative Agriculture, 2024, 23(1): 251-266.
[15]	Akmaral Baidyussen, Gulmira Khassanova, Maral Utebayev, Satyvaldy Jatayev, Rystay Kushanova, Sholpan Khalbayeva, Aigul Amangeldiyeva, Raushan Yerzhebayeva, Kulpash Bulatova, Carly Schramm, Peter Anderson, Colin L. D. Jenkins, Kathleen L. Soole, Yuri Shavrukov. *Assessment of molecular markers and marker-assisted selection for drought tolerance in barley (Hordeum* vulgare L.)**[J]. >Journal of Integrative Agriculture, 2024, 23(1): 20-38.

No Suggested Reading articles found!

Viewed

Full text

Abstract

Cited

Shared

Discussed

Cite this article:

About JIA

Editorial board

For authors