中国农业科学 ›› 2022, Vol. 55 ›› Issue (21): 4158-4174.doi: 10.3864/j.issn.0578-1752.2022.21.006
张杰1(),王川1,董晓霞1,祝文琪1,岳慧丽1,2,刘升平1,2(),周清波1,2()
收稿日期:
2022-01-03
接受日期:
2022-04-01
出版日期:
2022-11-01
发布日期:
2022-11-09
通讯作者:
刘升平,周清波
作者简介:
张杰,E-mail:基金资助:
ZHANG Jie1(),WANG Chuan1,DONG XiaoXia1,ZHU WenQi1,YUE HuiLi1,2,LIU ShengPing1,2(),ZHOU QingBo1,2()
Received:
2022-01-03
Accepted:
2022-04-01
Online:
2022-11-01
Published:
2022-11-09
Contact:
ShengPing LIU,QingBo ZHOU
摘要:
【目的】为了有效解决传统农业农村基础信息采集过程中存在的采集周期长、样本量小、投放不精准、数据质量低、审核难度大等难题,实现突发事件背景下海量数据快速获取及可视化分析,本研究设计、研发了一套集问卷精准投放、数据快速采集、结果自动分析为一体的农业农村信息快速调查平台,为各级农业管理部门快速决策提供便捷工具。【方法】(1)总体设计:借助5层架构技术和中台理念设计平台,采用新媒体、GIS、社会网络分析(SNA)等技术,构建问卷精准投放模型、多级裂变模式、快速审核和自动分析策略,利用点度中心度、中介中心度、空间聚类等方法对调查问卷传播网络的裂变关系、扩散能力以及社群特征进行分析,深度挖掘、多维度呈现平台数据价值。(2)系统实现:采用前后端分离模式研制了2个子系统,分别为面向调研用户的速调采集系统、服务于信息调查者的速调管理及分析系统。(3)平台应用:利用VMware vSphere集成容器和集群服务器部署系统,借助Nginx负载均衡方式提高系统响应速度。【结果】通过半年持续运行,系统普适性强,已提供8大领域12次大规模农业农村信息调查服务,共采集问卷76 953份;农业农村经济信息调查案例中5 h内采集了12 243份问卷,裂变比例为88.23%,其中20.24%的人形成扩散并裂变,社群效果明显,裂变程度高、速度快、范围广;平台综合功能强,覆盖了问卷设计、投放地控制、裂变分享、智能审核、酬劳发放、统计分析、用户沉淀等功能,可为农业农村信息快速调查提供高效的一站式服务。【结论】基于裂变模式的农业农村信息快速调查与分析平台,具有数据采集快、信息获取真、样本收集多、功能性强的特点,实现了突发事件背景下农业农村基础信息紧急获取及分析结果可视化呈现,形成了一种基于海量数据、区别于官方调查的民调模式,可为各级农业管理部门开展行业信息的精准、高效调查,实现科学决策提供有力的技术支撑,对其他行业信息调查具有借鉴意义。
张杰,王川,董晓霞,祝文琪,岳慧丽,刘升平,周清波. 基于裂变模式的农业农村信息快速调查及分析平台开发与应用[J]. 中国农业科学, 2022, 55(21): 4158-4174.
ZHANG Jie,WANG Chuan,DONG XiaoXia,ZHU WenQi,YUE HuiLi,LIU ShengPing,ZHOU QingBo. Development and Application of Rapid Investigation and Analysis Platform for Agricultural and Rural Information Based on Fission Model[J]. Scientia Agricultura Sinica, 2022, 55(21): 4158-4174.
表1
调查网络点出度分析"
点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | 点出度 OD | 占比 P(%) | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 79.76 | 10 | 0.13 | 19 | 0.04 | 28 | 0.02 | 62 | 0.02 | 63 | 0.01 | 167 | 0.01 | ||||||
1 | 11.61 | 12 | 0.12 | 22 | 0.04 | 34 | 0.02 | 111 | 0.02 | 66 | 0.01 | 172 | 0.01 | ||||||
2 | 2.99 | 15 | 0.09 | 35 | 0.04 | 37 | 0.02 | 24 | 0.01 | 74 | 0.01 | 175 | 0.01 | ||||||
3 | 1.45 | 14 | 0.06 | 13 | 0.03 | 40 | 0.02 | 31 | 0.01 | 84 | 0.01 | 182 | 0.01 | ||||||
4 | 1 | 17 | 0.06 | 21 | 0.03 | 41 | 0.02 | 32 | 0.01 | 97 | 0.01 | 193 | 0.01 | ||||||
5 | 0.60 | 16 | 0.05 | 23 | 0.03 | 42 | 0.02 | 43 | 0.01 | 106 | 0.01 | 209 | 0.01 | ||||||
6 | 0.35 | 18 | 0.05 | 26 | 0.03 | 45 | 0.02 | 49 | 0.01 | 107 | 0.01 | 280 | 0.01 | ||||||
8 | 0.19 | 20 | 0.04 | 27 | 0.03 | 46 | 0.02 | 50 | 0.01 | 108 | 0.01 | ||||||||
7 | 0.18 | 25 | 0.04 | 33 | 0.03 | 51 | 0.02 | 55 | 0.01 | 121 | 0.01 | ||||||||
9 | 0.18 | 29 | 0.04 | 36 | 0.03 | 53 | 0.02 | 58 | 0.01 | 142 | 0.01 | ||||||||
11 | 0.15 | 39 | 0.04 | 44 | 0.03 | 59 | 0.02 | 61 | 0.01 | 145 | 0.01 |
表2
信息调查常见方法耗时对比"
阶段划分 Stage division | 传统走访式 Traditional visiting survey | 逐层上报式 Step by step escalation survey | 线上随机式 Online random survey | 裂变式 Fission survey |
---|---|---|---|---|
找到受访者 Find the interviewees | 11人各分担一省,到目的地半天,找到受访者1天 11 people each went to a province, arrived at the destination for half a day, and found the interviewees for 1 day | 群聊方式,半小时传递给11省,再2小时由省传递给访问者 Through group chat, it would be delivered to 11 provinces in half an hour, and then delivered to interviewees by the provincial administrator in 2 hours | 多人反复转发,常规2人×3天 Repeatedly forwarded by multiple people, usually 2 people×3 days | 自行传播,常规2天 Self-transmitted, routinely 2 days |
问卷填写(每份问卷) Fill out the questionnaire (per questionnaire) | 6分钟填写,3分钟沟通,基本不可并行 6 minutes to fill out, 3 minutes to communicate, basically not parallel | 3分钟填写,可并行,但及时性很低 3 minutes to fill out, can be parallelized, but the timeliness is very low | 3分钟填写,可并行 3 minutes to fill out, can be parallelized | 3分钟填写,可并行 3 minutes to fill out, can be parallelized |
问卷审阅 Audit questionnaire | 2分钟/份 2 minutes/questionnaire | 2分钟/份,国家、省、市各审核一次, 人多时间不可控,需反复催促 2 minutes/questionnaire, the national, provincial and municipal managers would review it once, the time was uncontrollable due to the large number of people, and it needed to be repeatedly urged | 2分钟/份 2 minutes/questionnaire | 提前设置阈值,自动审核,10秒/份 Set thresholds in advance, automatic review, 10 seconds/ questionnaire |
预估总耗时 Estimated total time | 11人×2.5天=27.5人天 11 people×2.5 days = 27.5 people days | 11人×1天=11人天 11 people×1 day = 11 people days | 2人×4天=8人天 2 people×4 days = 8 people days | 1人×2天=2人天 1 person×2 days = 2 people days |
表3
信息调查常见方法功能对比"
功能描述 Feature description | 传统走访式Traditional walk-in style | 逐层上报式 Cascade reporting style | 线上随机式 Online random | 裂变式 Fissionable |
---|---|---|---|---|
电子问卷E-questionnaire | √ | √ | √ | |
问卷数量控制Control of the number of questionnaires | √ | √ | √ | |
投放地控制Placement control | √ | √ | ||
裂变式扩散Fissionable diffusion | √ | |||
数据导出Data export | √ | √ | √ | |
问卷审阅Questionnaire review | √ | √ | √ | √ |
智能审核Smart audit | √ | |||
酬劳发放Remuneration | √ | √ | ||
推广效果分析Promotion effect analysis | √ | |||
答题统计Answer statistics | √ | √ | ||
问卷空间分布Spatial distribution of questionnaires | √ | |||
专题分析Thematic analysis | √ | √ | ||
用户画像User profiling | √ | |||
用户分级User classification | √ | |||
用户沉淀User sedimentation | √ |
表4
平台历史调查结果"
问卷名称 Questionnaire name | 指标数量 Number of indicators | 发布时间 Release date (Y-M-D) | 采集时长 Duration of collection | 采集数量 Number of collections | 有效问卷数量 Number of valid questionnaires | 问卷有效率 Questionnaire efficiency(%) | 有效覆盖省数 Number of provinces effectively covered |
---|---|---|---|---|---|---|---|
7月农业农村经济信息调查 Agricultural and rural economic information survey in july | 21 | 2021-7-8 | 5 d | 541 | 506 | 93.53 | 29 |
农业农村信息速调系统水稻调查(7月) Agricultural and rural information rapid response system rice survey (July) | 16 | 2021-7-15 | 6 d | 17794 | 1554 | 8.73 | 17 |
居民乳制品消费调查 Residential dairy consumption survey | 23 | 2021-9-3 | 5 d | 7101 | 1056 | 14.87 | 12 |
农业农村信息速调系统水稻调查(9月) Agricultural and rural information rapid response system rice survey (September) | 30 | 2021-9-22 | 8 d | 3396 | 967 | 28.47 | 12 |
粮食作物秋收秋播调查 Autumn harvest and sowing survey for food crops | 20 | 2021-10-18 | 5 d | 1721 | 452 | 26.26 | 12 |
2021年青贮秋收调查 Silage autumn harvest survey in 2021 | 19 | 2021-10-23 | 3 d | 3905 | 533 | 13.65 | 9 |
京津冀地区婴幼儿乳粉品牌选择调研 Research on brand choice of infant milk powder in Beijing, Tianjin and Hebei | 31 | 2021-11-9 | 6 d | 2698 | 327 | 12.12 | 8 |
种植业产销经营中电子商务应用情况调查 Survey on the use of e-commerce in plantation production and marketing operations | 24 | 2021-11-29 | 2 d | 7809 | 1054 | 13.50 | 31 |
区域蜂产业发展调查 Regional bee industry development survey | 30 | 2021-12-9 | 9 h | 4001 | 1489 | 37.22 | 17 |
农业农村信息速调系统小麦调查 Survey of wheat for the agricultural rural information rapid response system | 13 | 2021-12-7 | 2.5 d | 6675 | 721 | 10.80 | 31 |
水果线上线下购买习惯和价格感知调研 Research on online and offline fruit buying habits and price perceptions | 19 | 2021-12-17 | 2 h | 9096 | 2972 | 32.77 | 31 |
农业农村经济信息调查 Agricultural and rural economic information survey | 29 | 2021-12-22 | 5 h | 12243 | 2228 | 18.20 | 31 |
[1] | 许世卫, 王东杰, 李哲敏. 大数据推动农业现代化应用研究. 中国农业科学, 2015, 48(17): 3429-3438. |
XU S W, WANG D J, LI Z M. Application research on big data promote agricultural modernization. Scientia Agricultura Sinica, 2015, 48(17): 3429-3438. (in Chinese) | |
[2] | 央视网. 习近平带政治局集体学习领导干部要学懂用好大数据. (2017-12-10)[2021-02-22]. http://news.cctv.com/2017/12/10/ARTI3H NR1LMiMiNZKmr1NMD1171210.shtml. |
CNTV. Chinese President Xi Jinping led the Political Bureau to learn collectively that leading cadres should learn to understand and make good use of big data.(2017-12-10)[2021-02-22]. http://news.cctv.com/2017/12/10/ARTI3H NR1LMiMiNZKmr1NMD1171210.shtml. (in Chinese) | |
[3] | 赵春江. 智慧农业发展现状及战略目标研究. 智慧农业, 2019, 1(1): 1-7. |
ZHAO C J. State-of-the-art and recommended developmental strategic objectives of smart agriculture. Smart Agriculture, 2019, 1(1): 1-7. (in Chinese) | |
[4] | GUPTA P, GOYAL K, KANTA P, GHOSH A, SINGH M P. Novel 2019-coronavirus on New Year's Eve. Indian Journal of Medical Microbiology, 2019, 37(4): 459-477. |
[5] | 张莉. 中国农业科学数据共享发展研究[D]. 北京: 中国农业科学院, 2006. |
ZHANG L. Research on the development of agricultural scientific data sharing in China[D]. Beijing: Chinese Academy of Agricultural Sciences, 2006. (in Chinese) | |
[6] | 陈迪, 吴文斌, 周清波, 胡琼, 项铭涛, 陆苗, 余强毅. 亚洲耕地利用格局十年变化特征研究. 中国农业科学, 2018, 51(6): 1106-1120. |
CHEN D, WU W B, ZHOU Q B, HU Q, XIANG M T, LU M, YU Q Y. Changes of cultivated land utilization pattern in Asia from 2000 to 2010. Scientia Agricultura Sinica, 2018, 51(6): 1106-1120. (in Chinese) | |
[7] | 郭新, 王乃江, 张玲玲, 郭永强, 褚晓升, 冯浩. 基于Google Earth Engine平台的关中冬小麦面积时空变化监测. 干旱地区农业研究, 2020, 38(3): 275-280. |
GUO X, WANG N J, ZHANG L L, GUO Y Q, CHU X S, FENG H. Monitoring of spatial-temporal change of winter wheat area in Guanzhong region based on Google Earth Engine. Agricultural Research in the Arid Areas, 2020, 38(3): 275-280. (in Chinese) | |
[8] | ATTILA N, JÁNOS F, JÁNOS T. Wheat and maize yield forecasting for the Tisza river catchment using MODIS NDVI time series and reported crop statistics. Computers and Electronics in Agriculture, 2018, 151: 41-49. |
[9] | CHEN D, LU M, ZHOU Q B, XIAO J F, RU Y T, WEI Y B, WU W B. Comparison of two synergy approaches for hybrid cropland mapping. Remote Sensing, 2019, 11(3): 213. |
[10] | LAMBIN E F, GIBBS H K, FERREIRA L, GRAU R, MAYAUX P, MEYFROIDT P, MORTON D C, RUDEL T K, GASPARRI I, MUNGER J. Estimating the world's potentially available cropland using a bottom-up approach. Global Environmental Change, 2013, 23(5): 892-901. |
[11] | 苏宇, 陈从喜, 王楠, 吴琪, 齐书花, 高宇, 朱先云. 自然资源综合统计成果体系及统计数据共享研究. 国土资源情报, 2021(1): 27-32. |
SU Y, CHEN C X, WANG N, WU Q, QI S H, GAO Y, ZHU X Y. Research on comprehensive statistical achievement system and statistical data sharing of natural resources. Land and Resources Information, 2021(1): 27-32. (in Chinese) | |
[12] | 孟召娣, 朱福守, 蒋和平. 国家现代农业示范区建设水平分析及提升对策研究. 农业现代化研究, 2018, 39(2): 185-193. |
MENG Z D, ZHU F S, JIANG H P. Development assessment of the national modern agricultural demonstration zone and some promotion suggestions. Research of Agricultural Modernization, 2018, 39(2): 185-193. (in Chinese) | |
[13] | 胡静, 金晓斌, 陈原, 杨剑, 周寅康. 土地整治重大工程项目建设监测管理系统的设计与实现. 中国土地科学, 2012, 26(7): 44-49, 97. |
HU J, JIN X B, CHEN Y, YANG J, ZHOU Y K. Design and implementation of monitoring and management system for the key land consolidation and readjustment projects. China Land Science, 2012, 26(7): 44-49,97. (in Chinese) | |
[14] | 李贝贝. 建立与国际接轨的新型农业统计体制与运行机制. 农业经济, 2014(8): 25-26. |
LI B B. Establish a new agricultural statistical system and operation mechanism in line with international standards. Agricultural Economy, 2014(8): 25-26. (in Chinese) | |
[15] | 王羡欠. 基于Java EE平台的网上调查问卷系统的设计与实现. 江西科学, 2016, 34(1): 129-132. |
WANG X Q. Design and implementation of online questionnaire system based on Java EE platform. Jiangxi Science, 2016, 34(1): 129-132. (in Chinese) | |
[16] | 许淳, 王文发, 李竹林. 一种通用调查问卷系统的设计与实现. 信息技术, 2016(6): 101-102, 106. |
XU C, WANG W F, LI Z L. Design and implementation of general survey system. Information Technology, 2016(6): 101-102, 106. (in Chinese) | |
[17] | 骆慧勇. 通用调查问卷系统设计与实现. 金融科技时代, 2018(1): 50-53. |
LUO H Y. Design and implementation of general questionnaire system. FinTech Time, 2018(1): 50-53. (in Chinese) | |
[18] | 卢锦运, 何怀金, 刘明. 支持逻辑跳转及填答约束的网络问卷调查系统设计与实现. 软件导刊, 2015, 14(1): 107-110. |
LU J Y, HE H J, LIU M. Design and implementation of network questionnaire survey system supporting logic jump and reply constraints. Software Guide, 2015, 14(1): 107-110. (in Chinese) | |
[19] | 夏兴生, 李忠义, 朱秀芳, 潘耀忠, 赵希振, 周巍. 基于遥感抽样的农作物种植面积测量野外调查系统设计与实践. 农业现代化研究, 2017, 38(6): 1075-1085. |
XIA X S, LI Z Y, ZHU X F, PAN Y Z, ZHAO X Z, ZHOU W. Design and practice of field survey system for crop acreage measurement based on remote sensing sampling. Research of Agricultural Modernization, 2017, 38(6): 1075-1085. (in Chinese) | |
[20] | 邓煜, 王建强, 张东东. 基于安卓系统的手持设备结合OZIExplorer软件在野外地质调查中的应用. 地层学杂志, 2016, 40(2): 219-224. |
DENG Y, WANG J Q, ZHANG D D. The application of android- based handled device with OZIExplorer in field geologcal investigation. Journal of Stratigraphy, 2016, 40(2): 219-224. (in Chinese) | |
[21] | 戚元华, 王慧, 张小波, 金艳, 格小光, 景志贤, 王凌, 赵宇平, 郭兰萍, 黄璐琦. 基于智能移动端的中药资源普查数据采集系统设计与实现. 中国中药杂志, 2017, 42(22): 4295-4298. |
QI Y H, WANG H, ZHANG X B, JIN Y, GE X G, JING Z X, WANG L, ZHAO Y P, GUO L P, HUANG L Q. Design and implementation of mobile terminal data acquisition for Chinese materia medica resources survey. China Journal of Chinese Materia Medica, 2017, 42(22): 4295-4298. (in Chinese) | |
[22] | 王英强, 陈绥阳, 王振铎. 大数据环境下农业统计数据采集平台的设计. 电子设计工程, 2018, 26(24): 111-115. |
WANG Y Q, CHEN S Y, WANG Z D. Design of agricultural statistical data acquisition platform in large data environment. Electronic Design Engineering, 2018, 26(24): 111-115. (in Chinese) | |
[23] | 王川, 董晓霞, 郑建华, 张超, 周清波. 基于移动互联的农业农村信息速调平台(Agri-watch)构建与应用. 农业大数据学报, 2020, 2(2): 104-111. |
WANG C, DONG X X, ZHENG J H, ZHANG C, ZHOU Q B. Construction and application of agricultural and rural information quick-obtainning platform (Agri-watch) based on mobile internet. Journal of Agricultural Big Data, 2020, 2(2): 104-111. (in Chinese) | |
[24] | 胡钦太, 林晓凡. 基于新媒体的社会教育传播模式构建研究. 电化教育研究, 2014(5): 5-10. |
HU Q T, LIN X F. Research on the construction of social education communication model based on new media. e-Education Research, 2014(5): 5-10. (in Chinese) | |
[25] | 史历峰. “刷屏广告”: 品牌形象建设的新策略. 新闻爱好者, 2020(2): 53-56. |
SHI L F. “Screen advertising”: A new strategy for brand image construction. Journalism Lover, 2020(2): 53-56. (in Chinese) | |
[26] | 陈鹏飞. 拼多多的拉新策略研究——基于红包分享的裂变效应. 现代商业, 2020(21): 43-45. |
CHEN P F. Research on Pinduoduo’s innovation strategy - Fission effect based on red envelope sharing. Modern Business, 2020(21): 43-45. (in Chinese) | |
[27] | 金韶, 倪宁. “社群经济”的传播特征和商业模式. 现代传播(中国传媒大学学报), 2016, 38(4): 113-117. |
JIN S, NI N. Communication characteristics and business model of “community economy”. Modern Communication (Journal of Communication University of China), 2016, 38(4): 113-117. (in Chinese) | |
[28] | 张杰, 刘升平, 岳慧丽, 吕纯阳, 洪葳. 智慧蜂业大数据平台建设与应用. 农业大数据学报, 2021, 3(1): 3-13. |
ZHANG J, LIU S P, YUE H L, LÜ C Y, HONG W. Construction and application of big data platform for intelligent apiculture. Journal of Agricultural Big Data, 2021, 3(1): 3-13. (in Chinese) | |
[29] | 仇阿根, 张杨, 罗宁, 赵习枝, 刘佳澄, 何望君. 结合微服务和中台理念的减灾服务系统设计与实现. 武汉大学学报(信息科学版), 2020, 45(8): 1288-1295. |
QIU A G, ZHANG Y, LUO N, ZHAO X Z, LIU J C, HE W J. Design and implementation of integrated disaster reduction intelligent service system based on micro-service architecture and middle platform concept. Geomatics and Information Science of Wuhan University, 2020, 45(8): 1288-1295. (in Chinese) | |
[30] | 姚艳, 牛明雷, 孙法军, 姚京婵, 常晓燕. 基于微服务架构的农业转移支付项目管理系统设计与实现. 中国农业科学, 2021, 54(15): 3207-3218. |
YAO Y, NIU M L, SUN F J, YAO J C, CHANG X Y. Design and implementation of agricultural transfer payment project management system based on micro-service architecture. Scientia Agricultura Sinica, 2021, 54(15): 3207-3218. (in Chinese) | |
[31] | 秦旋, 李怀全, 莫懿懿. 基于SNA视角的绿色建筑项目风险网络构建与评价研究. 土木工程学报, 2017, 50(2): 119-131. |
QIN X, LI H Q, MO Y Y. Study on establishment and evaluation of risk network in green building projects based on SNA. China Civil Engineering Journal, 2017, 50(2): 119-131. (in Chinese) | |
[32] | 邵玉河, 董振平. 图书馆微博的社会网络分析. 图书馆工作与研究, 2015(3): 28-32. |
SHAO Y H, DONG Z P. The social network analysis of library micro blog. Library Work and Study, 2015(3): 28-32. (in Chinese) | |
[33] | Scott J, Carrington P J. The SAGE Handbook of Social Network Analysis. America: SAGE, 2011. |
[34] | 刘华军, 刘传明, 孙亚男. 中国能源消费的空间关联网络结构特征及其效应研究. 中国工业经济, 2015(5): 83-95. |
LIU H J, LIU C M, SUN Y N. Spatial correlation network structure of energy consumption and its effect in China. China Industrial Economics, 2015(5): 83-95. (in Chinese) | |
[35] | 赵金楼, 成俊会. 基于SNA的突发事件微博舆情传播网络结构分析——以“4. 20四川雅安地震”为例. 管理评论, 2015, 27(1): 148-157. |
ZHAO J L, CHENG J H. Analysis of micro-blog public opinion diffusion based on SNA: An empirical study on April 20 Ya’an earthquake in Sichuan. Management Review, 2015, 27(1): 148-157. (in Chinese) | |
[36] | BLONDEL V D, GUILLAUME J L, LAMBIOTTE R, LEFEBVRE E. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(10): 10008. |
[37] | 邱晨子. 微博网络舆情热点生长分析模型研究[D]. 大连: 大连海事大学, 2013. |
QIU C Z. A Study on analysis model for the net-mediated public sentiment hotspot growth regulation in micro blog[D]. Dalian: Dalian Maritime University, 2013. (in Chinese) |
[1] | 姚艳,牛明雷,孙法军,姚京婵,常晓燕. 基于微服务架构的农业转移支付项目管理系统设计与实现[J]. 中国农业科学, 2021, 54(15): 3207-3218. |
|