首页 | 本学科首页   官方微博 | 高级检索  
     

单子叶作物叶片气孔自动识别与计数技术
引用本文:孙壮壮,姜东,蔡剑,王笑,周琴,黄梅,戴廷波,曹卫星. 单子叶作物叶片气孔自动识别与计数技术[J]. 农业工程学报, 2019, 35(23): 170-176
作者姓名:孙壮壮  姜东  蔡剑  王笑  周琴  黄梅  戴廷波  曹卫星
作者单位:南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095,南京农业大学农业部小麦区域技术创新中心,农业部南方作物生理生态重点开放实验室,南京 210095
基金项目:重点研发计划项目2016YFD0300107;国家自然科学基金(U1803235、31771693);国家现代小麦产业技术体系(CARS-03);江苏省协同创新中心(JCIC-MCP);"111"引智项目(B16026)
摘    要:为实现作物叶片气孔的自动识别与快速计数,该研究采用卷积神经网络中高计算效率的YOLOv3算法,开发了一种全自动气孔识别和计数解决方案。该算法优化了物体检测性能,可准确识别显微图像中的气孔。其中,对指甲油印迹法获得照片的气孔检测精确率、召回率和F1值分别为0.96,0.98和0.97,便携式显微镜拍摄法照片气孔检测精确率、召回率和F1值分别为0.95,0.98和0.96,具有很好的鲁棒性。该算法检测速度快,可实现对30帧/s的视频文件进行快速气孔识别,实现了实时检测。此外,采用拍摄的小麦叶片照片进行训练得到的气孔识别模型,还可同时实现对大麦、水稻和玉米等单子叶作物叶片气孔的识别,其中,大麦的检测精确率、召回率和F1值分别为0.94,0.83和0.88;水稻的检测精确率、召回率和F1值分别为0.89,0.42和0.57;玉米的检测精确率、召回率和F1值分别为0.91、0.76和0.83;显示出模型良好的泛化能力。

关 键 词:卷积神经网络  机器视觉  模型  单子叶作物  气孔识别  计数  深度学习  实时检测
收稿时间:2019-07-28
修稿时间:2019-10-22

Automatic identification and counting of leaf stomata of monocotyledonous crops
Sun Zhuangzhuang,Jiang Dong,Cai Jian,Wang Xiao,Zhou Qin,Huang Mei,Dai Tingbo and Cao Weixing. Automatic identification and counting of leaf stomata of monocotyledonous crops[J]. Transactions of the Chinese Society of Agricultural Engineering, 2019, 35(23): 170-176
Authors:Sun Zhuangzhuang  Jiang Dong  Cai Jian  Wang Xiao  Zhou Qin  Huang Mei  Dai Tingbo  Cao Weixing
Affiliation:Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China,Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China and Regional Technique Innovation Center for Wheat Production, Ministry of Agriculture, Key Laboratory of Crop Physiology and Ecology in Southern China, Ministry of Agriculture, Nanjing Agricultural University, Nanjing 210095, China
Abstract:Stomata is the dominant gate for water and gas exchange for plant leaves, and thus plays key roles in plants in response to the fluctuations of the environmental variables. Observation and counting stomata amounts is generally one of the obligatory determinants in the research of plant ecology and physiology. The classic measurement protocol of leaf stomata usually includes the capture of leaf stomata by a microscope, followed by manually identifying and counting of the target stomata. This method is well-known in disadvantages of both time and labor consuming, and of low accuracy. Although some algorithms for stomata recognition have been proposed at present, their recognition abilities showed limitation, and they could not realize the full effect of automatic recognition. Thereafter, we developed an automatic identification and counting technique based on YOLOv3, one of the high speed convolutional neural networks (CNN) algorithm in the present study. We acquired pictures of leaf stomata after the third leaf occurred and during grain filling stage of wheat (Triticum aestivum), in which, 138 pictures were taken from the method of nail polish printing, and another 117 pictures were taken from the method of portable microscopy. After that, we created separate data sets and then trained the corresponding models respectively. During the training process, we visualized the loss and average loss which were the most important training parameters, and finally stopped the training at 1 200 times. To better describe the parameters of both models, we used the key metrics to evaluate the models, such as precision, recall and F1. The precision, recall and F1 reached 0.96, 0.98 and 0.97 in the method of nail polish printing, whereas reached 0.95, 0.98 and 0.96 in the method of portable microscopy. Secondly, this algorithm could count stomata amounts accurately, and showed excellent robustness. By linear regression between the labeled and predicted stomata amounts in pictures from test sets, we found that this algorithm showed strong correlation, R2 were 0.980 1 and 0.962 5, respectively. What''s more, this algorithm also showed high performance in high-throughput and real-time, since it identified stomata with a speed of 30 frames per second. With this technique, we optimized the objective identifying performance, which conferred accurate identification performance of stomata in the microscope pictures of leaf stomata. Firstly, compared with the method of nail polish printing, the method of portable microscopy showed low precision and F1, but was harmless to samples. Secondly, YOLOv3 algorithm exhibited the merits of accuracy, high efficiency, as well as real-time, long-time and dynamic detection. Thirdly, this technique was high compatible due to its power in accurately identifying stomata of other monocotyledonous crops such as barley (Hordeum vulgare), rice (Oryza sativa) and maize (Zea mays). Lastly, in order to facilitate the use of more researchers, we not only opened source of the detailed Python code, but also encapsulated the method in a relatively complete way. It could provide an interface for relevant researchers to detect their stomata photo or video files. The files in our stomata project could be consulted and downloaded in Github (https://github.com/shem123456/).
Keywords:convolutional neural network   machine vision   models   monocotyledonous crop   stomata identification   stomata counting   deep learning   real-time detection
本文献已被 CNKI 等数据库收录!
点击此处可从《农业工程学报》浏览原始摘要信息
点击此处可从《农业工程学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号