Data Acquisition on Network Public Opinion of Emergencies Based on Web Crawler Technology
			
				 Download as PDF
Download as PDF
			
			
				DOI: 10.23977/icmmct.2019.62133			
			
				Author(s)
				Yanmei Wang, Yongchang Ren
			 
			
				
Corresponding Author
				Yanmei Wang			
			
				
ABSTRACT
				Emergency network public opinion refers to the sum of opinions, feelings, and attitudes issued by cyber citizens. In the big data environment, rapid analysis of massive network data, establishment of public opinion monitoring and guidance mechanisms, and decision support for managers have become a new development direction. Data collection is an important task. Web crawler technology is a convenient and quick effective method to collect network data. Guided by the basic principles of web crawler technology, this paper analyzes the data collection process of emergency network lyrics, and uses the breadth-first algorithm to design the information acquisition process based on web crawler technology, which provides complete solution of data collection for emergency network public opinion.			
			
				
KEYWORDS
				Big data, emergencies, network public opinion, data acquisition, Web crawler technology, data acquisition process