Please wait a minute...
Journal of Integrative Agriculture  2020, Vol. 19 Issue (5): 1292-1300    DOI: 10.1016/S2095-3119(19)62829-7
Special Issue: 植物病理合辑Plant Protection—Plant Pathology 智慧植保合辑Smart Plant Protection
Plant Protection Advanced Online Publication | Current Issue | Archive | Adv Search |
MmNet: Identifying Mikania micrantha Kunth in the wild via a deep Convolutional Neural Network
QIAO Xi1, 2*, LI Yan-zhou3*, SU Guang-yuan4*, TIAN Hong-kun3, ZHANG Shuo5, SUN Zhong-yu6, YANG Long6, WAN Fang-hao1, QIAN Wan-qiang1 
1 Agricultural Genomics Institute at Shenzhen, Chinese Academy of Agricultural Sciences, Shenzhen 518120, P.R.China
2 Key Laboratory of Integrated Pest Management on Crops in South China, Ministry of Agriculture and Rural Affairs/South China Agricultural University, Guangzhou 510642, P.R.China
3 College of Mechanical Engineering, Guangxi University, Nanning 530004, P.R.China
4 Shaanxi Agricultural Machinery Appraisal Station, Xi’an 710065, P.R.China
5 College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling 712100, P.R.China
6 Guangzhou Institude of Geography, Guangdong Academy of Sciences, Guangzhou 510070, P.R.China
Download:  PDF in ScienceDirect  
Export:  BibTeX | EndNote (RIS)      
Abstract  
Mikania micrantha Kunth is an invasive alien weed and known as a plant killer around the world.  Accurately and rapidly identifying M. micrantha in the wild is important for monitoring its growth status, as this helps management officials to take the necessary steps to devise a comprehensive strategy to control the invasive weed in the identified area.  However, this approach still mainly depends on satellite remote sensing and manual inspection.  The cost is high and the accuracy rate and efficiency are low.  We acquired color images of the monitoring area in the wild environment using an Unmanned Aerial Vehicle (UAV) and proposed a novel network -MmNet- based on a deep Convolutional Neural Network (CNN) to identify M. micrantha in the images.  The network consists of AlexNet Local Response Normalization (LRN), along with the GoogLeNet and continuous convolution of VGG inception models.  After training and testing, the identification of 400 testing samples by MmNet is very good, with accuracy of 94.50% and time cost of 10.369 s.  Moreover, in quantitative comparative analysis, the proposed MmNet not only has high accuracy and efficiency but also simple construction and outstanding repeatability.  Compared with recently popular CNNs, MmNet is more suitable for the identification of M. micrantha in the wild.  However, to meet the challenge of wild environments, more M. micrantha images need to be acquired for MmNet training.  In addition, the classification labels need to be sorted in more detail.  Altogether, this research provides some theoretical and scientific basis for the development of intelligent monitoring and early warning systems for M. micrantha and other invasive species. 
Keywords:  Mikania micrantha Kunth        invasive alien plant        image processing        deep learning  
Received: 17 July 2019   Accepted:
Fund: The authors thank the native English speaking experts from the editing team of American Journal Experts for polishing our paper. The work in this paper was supported by the National Natural Science Foundation of China (3180111238), the Fund Project of the Key Laboratory of Integrated Pest Management on Crops in South China, Ministry of Agriculture and Rural Affairs, China (SCIPM2018-05), the Key Research and Development Program of Nanning, China (20192065), the Guangdong Science and Technology Planning Project, China (2017A020216022), and the Industrial Development Fund Support Project of Dapeng District, Shenzhen, China (KY20180117).
Corresponding Authors:  Correspondence QIAN Wan-qiang, E-mail: qianwanqiang@caas.cn; WAN Fang-hao, E-mail: wanfanghao@caas.cn    
About author:  Qiao Xi, E-mail: qiaoxi@caas.cn; * These authors contributed equally to this study.

Cite this article: 

QIAO Xi, LI Yan-zhou, SU Guang-yuan, TIAN Hong-kun, ZHANG Shuo, SUN Zhong-yu, YANG Long, WAN Fang-hao, QIAN Wan-qiang. 2020.

MmNet: Identifying Mikania micrantha Kunth in the wild via a deep Convolutional Neural Network
. Journal of Integrative Agriculture, 19(5): 1292-1300.

Adam E, Mureriwa N, Newete S. 2017. Mapping Prosopis glandulosa (mesquite) in the semi-arid environment of South Africa using high-resolution WorldView-2 imagery and machine learning classifiers. Journal of Arid Environments, 145, 43–51.
Ampatzidis Y, De Bellis L, Luvisi A. 2017. iPathology: Robotic applications and management of plants and plant diseases. Sustainability, 9, 1010.
Bao T, Melenka G W, Ljubotina M K, Carey J P, Cahill Jr J F. 2018. A new method for the rapid characterization of root growth and distribution using digital image correlation. New Phytologist, 218, 835–846.
Barbosa J, Asner G, Martin R, Baldeck C, Hughes F, Johnson T. 2016. Determining subcanopy Psidium cattleianum invasion in hawaiian forests using imaging spectroscopy. Remote Sensing, 8, 33.
Brahimi M, Boukhalfa K, Moussaoui A. 2017. Deep Learning for tomato diseases: Classification and symptoms visualization. Applied Artificial Intelligence, 31, 299–315.
Bustamante J, Aragonés D, Afán I, Luque C, Pérez-Vázquez A, Castellanos E, Díaz-Delgado R. 2016. Hyperspectral sensors as a management tool to prevent the invasion of the exotic cordgrass Spartina densiflora in the Doñana wetlands. Remote Sensing, 8, 1001.
Choudhury M R, Deb P, Singha H, Chakdar B, Medhi M. 2016. Predicting the probable distribution and threat of invasive Mimosa diplotricha Suavalle and Mikania micrantha Kunth in a protected tropical grassland. Ecological Engineering, 97, 23–31.
Clements D R, Day M D, Oeggerli V, Shen S C, Weston L A, Xu G F, Zhang F D, Zhu X, Novak S. 2019. Site-specific management is crucial to managing Mikania micrantha. Weed Research, 59, 155–169.
Curatola Fernández G F, Silva B, Gawlik J, Thies B, Bendix J. 2013. Bracken fern frond status classification in the Andes of southern Ecuador: Combining multispectral satellite data and field spectroscopy. International Journal of Remote Sensing, 34, 7020–7037.
Dorigo W, Lucieer A, Podobnikar T, ?arni A. 2012. Mapping invasive Fallopia japonica by combined spectral, spatial, and temporal analysis of digital orthophotos. International Journal of Applied Earth Observation and Geoinformation, 19, 185–195.
Fuentes A, Yoon S, Kim S C, Park D S. 2017. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors, 17, 2022.
Ge S, Carruthers R, Gong P, Herrera A. 2006. Texture analysis for mapping Tamarix parviflora using aerial photographs along the Cache Creek, California. Environmental Monitoring and Assessment, 114, 65–83.
He K, Zhang X, Ren S, Sun J. 2016. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition. IEEE Location, Seattle, USA. pp. 770–778.
Hung C, Xu Z, Sukkarieh S. 2014. Feature learning based approach for weed classification using high resolution aerial images from a digital camera mounted on a UAV. Remote Sensing, 6, 12037–12054.
Jones D, Pike S, Thomas M, Murphy D. 2011. Object-based image analysis for detection of Japanese Knotweed s.l. taxa (Polygonaceae) in wales (UK). Remote Sensing, 3, 319–342.
Kganyago M, Odindi J, Adjorlolo C, Mhangara P. 2018. Evaluating the capability of Landsat 8 OLI and SPOT 6 for discriminating invasive alien species in the African Savanna landscape. International Journal of Applied Earth Observation and Geoinformation, 67, 10–19.
Khare S, Latifi H, Ghosh S K. 2018. Multi-scale assessment of invasive plant species diversity using Pléiades 1A, RapidEye and Landsat-8 data. Geocarto International, 33, 681–698.
Krizhevsky A, Sutskever I, Hinton G E. 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60, 84–90.
Lecun Y, Bottou L E, Bengio Y, Haffner P. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86, 2278–2324.
Liu M, Li H, Li L, Man W, Jia M, Wang Z, Lu C. 2017. Monitoring the invasion of spartina alterniflora using multi-source high-resolution imagery in the Zhangjiang Estuary, China. Remote Sensing, 9, 539.
Lu H, Cao Z, Xiao Y, Zhuang B, Shen C. 2017. TasselNet: Counting maize tassels in the wild via local counts regression network. Plant Methods, 13, 79.
Mafanya M, Tsele P, Botai J O, Manyama P, Chirima G J, Monate T. 2018. Radiometric calibration framework for ultra-high-resolution UAV-derived orthomosaics for large-scale mapping of invasive alien plants in semi-arid woodlands: Harrisia pomanensis as a case study. International Journal of Remote Sensing, 39, 5119–5140.
Müllerová J, Pergl J, Pyšek P. 2013. Remote sensing as a tool for monitoring plant invasions: Testing the effects of data resolution and image classification approach on the detection of a model plant species Heracleum mantegazzianum (giant hogweed). International Journal of Applied Earth Observation and Geoinformation, 25, 55–65.
Nagendra H, Lucas R, Honrado J P, Jongman R H G, Tarantino C, Adamo M, Mairota P. 2013. Remote sensing for conservation monitoring: Assessing protected areas, habitat extent, habitat condition, species diversity, and threats. Ecological Indicators, 33, 45–59.
Narumalani S, Mishra D R, Wilson R, Reece P, Kohler A. 2009. Detecting and mapping four invasive species along the floodplain of North Platte River, Nebraska. Weed Technology, 23, 99–107.
Nath A, Sinha A, Lahkar B P, Brahma N. 2019. In search of aliens: Factors influencing the distribution of Chromolaena odorata L. and Mikania micrantha Kunth in the Terai grasslands of Manas National Park, India. Ecological Engineering, 131, 16–26.
Pound M P, Atkinson J A, Townsend A J, Wilson M H, Griffiths M, Jackson A S, Bulat A, Tzimiropoulos G, Wells D M, Murchie E H, Pridmore T P, French A P. 2017. Deep Machine Learning provides state-of-the-art performance in image-based plant phenotyping. GigaScience, 6, 1–10.
Pouteau R, Meyer J Y, Stoll B. 2011. A SVM-based model for predicting distribution of the invasive tree Miconia calvescens in tropical rainforests. Ecological Modelling, 222, 2631–2641.
Rahnemoonfar M, Sheppard C. 2017. Deep count: Fruit counting based on deep simulated learning. Sensors, 17, 905.
Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes D P. 2017. Deep learning for image-based cassava disease detection. Frontiers in Plant Science, 8, 1852.
Roth K L, Roberts D A, Dennison P E, Peterson S H, Alonzo M. 2015. The impact of spatial resolution on the classification of plant species and functional types within imaging spectrometer data. Remote Sensing of Environment, 171, 45–57.
Sandino J, Gonzalez F, Mengersen K, Gaston K J. 2018. UAVs and machine learning revolutionising invasive grass and vegetation surveys in remote arid lands. Sensors, 18, 605.
Schulte to Bühne H, Pettorelli N, Lecomte N. 2018. Better together: Integrating and fusing multispectral and radar satellite imagery to inform biodiversity monitoring, ecological research and conservation science. Methods in Ecology and Evolution, 9, 849–865.
Shen S, Shen Z, Zhao M. 2017. Big data monitoring system design and implementation of invasive alien plants based on WSNs and WebGIS. Wireless Personal Communications, 97, 4251–4263.
Sidike P, Sagan V, Maimaitijiang M, Maimaitiyiming M, Shakoor N, Burken J, Mockler T, Fritschi F B. 2019. dPEN: Deep progressively expanded network for mapping heterogeneous agricultural landscape using WorldView-3 satellite imagery. Remote Sensing of Environment, 221, 756–772.
Simonyan K, Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations 2015. International Conference on Learning Representations (ICLR), San Diego. pp. 1–14,
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. 2015. Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Boston, USA. pp. 1–9.
Szegedy C, Vanhoucke V, Ioffe S, Shlens J. 2016. Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition.  IEEE, Las Vegas, USA. pp. 2818–2826.
Tarantino C, Casella F, Adamo M, Lucas R, Beierkuhnlein C, Blonda P. 2019. Ailanthus altissima mapping from multi-temporal very high resolution satellite images. ISPRS Journal of Photogrammetry and Remote Sensing, 147, 90–103.
Ustin S L, Gamon J A. 2010. Remote sensing of plant functional types. New Phytologist, 186, 795–816.
Walter A, Scharr H, Gilmer F, Zierer R, Nagel K A, Ernst M, Wiese A, Virnich O, Christ M M, Uhlig B, Junger S, Schurr U. 2007. Dynamics of seedling growth acclimation towards altered light conditions can be quantified via GROWSCREEN: A setup and procedure designed for rapid optical phenotyping of different plant species. New Phytologist, 174, 447–55.
Wang R L, Zhu-Salzman K, Elzaki M E A, Huang Q Q, Chen S, Ma Z H, Liu S W, Zhang J E. 2019. Mikania micrantha wilt virus alters insect vector’s host preference to enhance its own spread. Viruses, 11, 336.
West A M, Evangelista P H, Jarnevich C S, Young N E, Stohlgren T J, Talbert C, Talbert M, Morisette J, Anderson R. 2016. Integrating remote sensing with species distribution models; Mapping tamarisk invasions using the software for assisted habitat modeling (SAHM). Journal of Visualized Experiments, 116, e54578.
Wu Z, Guo Q, Li M G, Jiang L, Li F, Zan Q, Zheng J. 2013. Factors restraining parasitism of the invasive vine Mikania micrantha by the holoparasitic plant Cuscuta campestris. Biological Invasions, 15, 2755–2762.
Zeng G, Birchfield S T, Wells C E. 2008. Automatic discrimination of fine roots in minirhizotron images. New Phytologist, 177, 549–557.
[1] WU Wei, YANG Tian-le, LI Rui, CHEN Chen, LIU Tao, ZHOU Kai, SUN Cheng-ming, LI Chun-yan, ZHU Xin-kai, GUO Wen-shan. Detection and enumeration of wheat grains based on a deep learning method under various scenarios and scales[J]. >Journal of Integrative Agriculture, 2020, 19(8): 1998-2008.
[2] YAO Qing, FENG Jin, TANG Jian, XU Wei-gen, ZHU Xu-hua, YANG Bao-jun, Lü Jun, XIE Yi-ze, YAO Bo, WU Shu-zhen, KUAI Nai-yang, WANG Li-jun. Development of an automatic monitoring system for rice light-trap pests based on machine vision[J]. >Journal of Integrative Agriculture, 2020, 19(10): 2500-2513.
[3] TU Ke-ling, LI Lin-juan, YANG Li-ming, WANG Jian-hua, SUN Qun. Selection for high quality pepper seeds by machine vision and classifiers[J]. >Journal of Integrative Agriculture, 2018, 17(09): 1999-2006.
[4] YAO Qing, CHEN Guo-te, WANG Zheng, ZHANG Chao1 YANG Bao-jun, TANG Jian. Automated detection and identification of white-backed planthoppers in paddy fields using image processing[J]. >Journal of Integrative Agriculture, 2017, 16(07): 1547-1557.
No Suggested Reading articles found!