Author(s)

Bo Li ¹, Shiwei Ma ¹

Affiliation(s)

¹ Baidu APP Technology and Platform R&D Department, Baidu Inc, Beijing, China

Corresponding Author

Bo Li

ABSTRACT

With the development of cloud computing and the continuous development of infrastructure, architecture upgrades and other technologies, Baidu's internal services are gradually moving to the cloud environment. Although the efficiency of services has increased significantly, some shortcomings and deficiencies of the basic capabilities of the cloud environment have gradually become apparent, resulting in the inability to meet some reasonable requirements of the enterprise, such as building the topology relationship between different microservices and conducting the test session for The traditional way of implementation is to record the real traffic to reflect and verify the function and so on. The traditional way of implementation is often to implant the code into the business system to make changes. However, given the diversity of business forms and technologies, the conventional way has a lot of problems in terms of business intervention, communication and coordination, performance, stability, and other aspects. In this paper, we introduce Baidu's eBPF-based network framework: DeeTune, which provides the ability to create service topology, record traffic, monitor non-intrusive metrics, etc., further improve the efficiency of SRE and quality assurance.

KEYWORDS

eBPF, Performance, Profiling, Tracing, Cloud computing

CITE THIS PAPER

Bo Li, Shiwei Ma, DeeTune: Design and Application of an eBPF-based Network Framework for Baidu. Journal of Artificial Intelligence Practice (2023) Vol. 6: 29-35. DOI: http://dx.doi.org/10.23977/jaip.2023.060605.

REFERENCES

[1] Miano S, Bertrone M, Risso F, et al. Creating complex network services with ebpf: Experience and lessons learned[C]//2018 IEEE 19th International Conference on High Performance Switching and Routing (HPSR). IEEE, 2018: 1-8.
[2] Kehoe M. eBPF: The next power tool of SRE's [J]. USENIX Association, 2022.
[3] Deri L, Sabella S, Mainardi S, et al. Combining System Visibility and Security Using eBPF[C]//ITASEC. 2019.
[4] Cassagnes C, Trestioreanu L, Joly C, et al. The rise of eBPF for non-intrusive performance monitoring[C]//NOMS 2020-2020 IEEE/IFIP Network Operations and Management Symposium. IEEE, 2020: 1-7. 
[5] Sedghpour M R S, Townend P. Service mesh and ebpf-powered microservices: A survey and future directions [C]//2022 IEEE International Conference on Service-Oriented System Engineering (SOSE). IEEE, 2022: 176-184.
[6] Liu C, Cai Z, Wang B, et al. A protocol-independent container network observability analysis system based on eBPF[C] //2020 IEEE 26th International Conference on Parallel and Distributed Systems (ICPADS). IEEE, 2020: 697-702.
[7] Kwak J H. A study on how to build a supercomputer monitoring and performance analysis system based on Performance Co-Pilot, Bpftrace and Grafana[C]//Proceedings of the Korea Information Processing Society Conference. Korea Information Processing Society, 2021: 118-121.
[8] Gregg B. Linux performance [J]. Online]. http://www. brendangregg. com/linuxperf. html, 2018.
[9] Qi S, Kulkarni S G, Ramakrishnan K K. Understanding container network interface plugins: design considerations and performance [C]//2020 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN. IEEE, 2020: 1-6.
[10] Zhang QX, Wu YF, Yang Y, et al. Survey on Service Dependency Discovery Technology for Microservice Systems[J]. Journal of Software, 2023: 1-18.
[11] https://github.com/coroot/coroot

Sponsors, Associates, and Links

---

• Power Systems Computation
  
  
• Internet of Things (IoT) and Engineering Applications
  
  
• Computing, Performance and Communication Systems
  
  
• Advances in Computer, Signals and Systems
  
  
• Journal of Network Computing and Applications
  
  
• Journal of Web Systems and Applications
  
  
• Journal of Electrotechnology, Electrical Engineering and Management
  
  
• Journal of Wireless Sensors and Sensor Networks
  
  
• Journal of Image Processing Theory and Applications
  
  
• Mobile Computing and Networking
  
  
• Vehicle Power and Propulsion
  
  
• Frontiers in Computer Vision and Pattern Recognition
  
  
• Knowledge Discovery and Data Mining Letters
  
  
• Big Data Analysis and Cloud Computing
  
  
• Electrical Insulation and Dielectrics
  
  
• Crypto and Information Security
  
  
• Journal of Neural Information Processing
  
  
• Collaborative and Social Computing
  
  
• International Journal of Network and Communication Technology
  
  
• File and Storage Technologies
  
  
• Frontiers in Genetic and Evolutionary Computation
  
  
• Optical Network Design and Modeling
  
  
• Journal of Virtual Reality and Artificial Intelligence
  
  
• Natural Language Processing and Speech Recognition
  
  
• Journal of High-Voltage
  
  
• Programming Languages and Operating Systems
  
  
• Visual Communications and Image Processing
  
  
• Journal of Systems Analysis and Integration
  
  
• Knowledge Representation and Automated Reasoning
  
  
• Review of Information Display Techniques
  
  
• Data and Knowledge Engineering
  
  
• Journal of Database Systems
  
  
• Journal of Cluster and Grid Computing
  
  
• Cloud and Service-Oriented Computing
  
  
• Journal of Networking, Architecture and Storage
  
  
• Journal of Software Engineering and Metrics
  
  
• Visualization Techniques
  
  
• Journal of Parallel and Distributed Processing
  
  
• Journal of Modeling, Analysis and Simulation
  
  
• Journal of Privacy, Trust and Security
  
  
• Journal of Cognitive Informatics and Cognitive Computing
  
  
• Lecture Notes on Wireless Networks and Communications
  
  
• International Journal of Computer and Communications Security
  
  
• Journal of Multimedia Techniques
  
  
• Automation and Machine Learning
  
  
• Computational Linguistics Letters
  
  
• Journal of Computer Architecture and Design
  
  
• Journal of Ubiquitous and Future Networks