Education, Science, Technology, Innovation and Life
Open Access
Sign In

Data Acquisition on Network Public Opinion of Emergencies Based on Web Crawler Technology

Download as PDF

DOI: 10.23977/icmmct.2019.62133

Author(s)

Yanmei Wang, Yongchang Ren

Corresponding Author

Yanmei Wang

ABSTRACT

Emergency network public opinion refers to the sum of opinions, feelings, and attitudes issued by cyber citizens. In the big data environment, rapid analysis of massive network data, establishment of public opinion monitoring and guidance mechanisms, and decision support for managers have become a new development direction. Data collection is an important task. Web crawler technology is a convenient and quick effective method to collect network data. Guided by the basic principles of web crawler technology, this paper analyzes the data collection process of emergency network lyrics, and uses the breadth-first algorithm to design the information acquisition process based on web crawler technology, which provides complete solution of data collection for emergency network public opinion.

KEYWORDS

Big data, emergencies, network public opinion, data acquisition, Web crawler technology, data acquisition process

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.