Education, Science, Technology, Innovation and Life
Open Access
Sign In

Research on Parallel Processing Framework of Power Big Data

Download as PDF

DOI: 10.23977/iccsc.2017.1001

Author(s)

HU Bin, LUO Li-ming, YANG Pei, HUANG Tai-gui and ZHANG Li-ping

Corresponding Author

HU Bin

ABSTRACT

With the application of the power of big data landing and deepening, which put forward higher requirements on the performance analysis, and based on multi node parallel processing technology will become one of the core support technology and the rapid development of the application of power analysis of big data. This paper briefly analyzes the application requirements of large power parallel data processing, this paper presents a parallel processing framework for the power of big data and the realization method of management services and computing services in detail the design, research and development of parallel processing platform for the power of big data, and based on the national power quality monitoring data, comparison test Hive and 1.1.0. Compared with the experimental results, the results show that, when the node size is relatively small, the power big data parallel processing platform is less obvious than Hive 1.1.0. However, with the increasing size of the nodes, the advantages of the large data parallel processing platform of power are larger than that of Hive 1.1.0.

KEYWORDS

Power big data, Parallel Processing, Power quality, Hive

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.