农业图书情报学报 ›› 2020, Vol. 32 ›› Issue (5): 76-81.doi: 10.13998/j.cnki.issn1002-1248.2019.10.17-0917

• 农业信息服务 • 上一篇    

基于Python的农村土地流转新闻文本采集与分析

刘鑫东, 邬锦雯, 刘丁扬, 周巧怡   

  1. 华南师范大学经济与管理学院,广州 511400
  • 收稿日期:2019-10-17 出版日期:2020-05-05 发布日期:2020-05-20
  • 作者简介:刘鑫东(1994-),女,硕士研究生,研究方向:信息政策,文本分析。邬锦雯(1969-),女,博士,教授,研究方向:信息政策。刘丁扬(1996-),男,硕士研究生,研究方向:信息政策。周巧怡(1993-),女,硕士研究生,研究方向:信息政策。
  • 基金资助:
    广东省学位与研究生教育改革项目(项目编号:2018JGXM31)

Collection and Analysis of Rural Land Circulation News Text Based on Python

LIU Xindong, WU Jinwen, LIU Dingyan, ZHOU QiaoYi   

  1. School of Economics & Management, South China Normal University, Guangzhou 511400
  • Received:2019-10-17 Online:2020-05-05 Published:2020-05-20

摘要: [目的/意义]为快速获取网页中土地流转资讯的海量数据,借助当前数据采集和分析的热门手段——网络爬虫技术,从新闻资讯的视角挖掘和整理国内对农村土地流转关注的新热点。[方法/过程]以人民网为目标网页,通过对网页的关键词检索,利用Python语言编写、设计程序对网页中的农地流转的新闻资讯进行爬取,将获取的2 500多条新闻作为数据样本,利用文本分析方法以及绘制Python词云图分析农地流转现状、内容及问题。[结果/结论]对网页新闻资讯进行爬取,通过对采集的新闻内容进行统计分析,热点挖掘后发现,当前国内对农地流转的宣传和重视程度逐渐加深,农地流转建设与精准扶贫、乡村旅游和合作社有密切的发展联系。从而对这3个方面现存的问题进行分析并提出建议。

关键词: 网络爬虫, 文本采集, 文本分析, 土地流转

Abstract: [Purpose / Significance] In order to quickly obtain a massive amount of data of land transfer on the Internet, with the help of the current popular method of data collection and analysis-web crawler technology, the new hot spots of rural land transfer in China are excavated and sorted out from the perspective of news and information. [Method / Process] Taking People's Daily as the target web page, we search keywords on the web page and use Python to write and design programs to crawl the news documents of farmland circulation on the web page. and We then use the obtained more than 2 500 pieces of news as data to analyze the status, content and problems of agricultural land transfer by using text analysis methods and drawing Python word cloud diagrams. [Results / Conclusions] Crawling the web news information, through statistical analysis of the collected news content, after hot spot mining, it is found that China is attaching more importance to the transfer of agricultural land and increased publicity in this regard, The construction of agricultural land transfer and precision poverty alleviation, and rural tourism and cooperatives are closely connected with one another. At last we analyze the existing problems in above-mentioned three aspects and make recommendations.

Key words: web crawler, text collection, text analysis, land transfer

中图分类号: 

  • G354.2

引用本文

刘鑫东, 邬锦雯, 刘丁扬, 周巧怡. 基于Python的农村土地流转新闻文本采集与分析[J]. 农业图书情报学报, 2020, 32(5): 76-81.

LIU Xindong, WU Jinwen, LIU Dingyan, ZHOU QiaoYi. Collection and Analysis of Rural Land Circulation News Text Based on Python[J]. Journal of Library and Information Science in Agriculture, 2020, 32(5): 76-81.