Data Acquisition on Network Public Opinion of Emergencies Based on Web Crawler Technology
Download as PDF
DOI: 10.23977/icmmct.2019.62133
Author(s)
Yanmei Wang, Yongchang Ren
Corresponding Author
Yanmei Wang
ABSTRACT
Emergency network public opinion refers to the sum of opinions, feelings, and attitudes issued by cyber citizens. In the big data environment, rapid analysis of massive network data, establishment of public opinion monitoring and guidance mechanisms, and decision support for managers have become a new development direction. Data collection is an important task. Web crawler technology is a convenient and quick effective method to collect network data. Guided by the basic principles of web crawler technology, this paper analyzes the data collection process of emergency network lyrics, and uses the breadth-first algorithm to design the information acquisition process based on web crawler technology, which provides complete solution of data collection for emergency network public opinion.
KEYWORDS
Big data, emergencies, network public opinion, data acquisition, Web crawler technology, data acquisition process