Author(s)

Zhang Lili, Wan Yunwu, Wang Lei, Liu Hui

Corresponding Author

Zhang Lili

ABSTRACT

In recent years, urban road transport vehicle dynamic supervision and management of in-depth, constantly strengthen continuously, but also has a lot of problems and insufficiency. the transportation management office for different business management requirements have different management systems, Most of these systems and database are independent of each other, Each system is unable to share data, so We can't make full use of each system data to complete the dynamic regulation of road transport. Based on Hadoop and ETL technology, through the establishment of big data platform and data exchange sharing platform and data mart to implement the data cleaning and processing business. Data cleaning and processing business priorities to finish the unification of the huge amounts of data storage, management, information sharing and service to provide data resources. And as a support of application system, in view of the different business set up different topics. Establish a perfect architecture for data acquisition, loading, storage, analysis and application show, complete system data fusion, comprehensive dynamic regulation of road transport.

KEYWORDS

Hadoop, ETL, Big data, data cleaning