Cost-sensitive Layer-7 Load Balancing Under Bursty Enterprise Cloud Traffic Conditions

Authors

  • Katharina Schmitz Institute of Computer Science, Faculty of Physics, Mathematics and Computer Science, Johannes Gutenberg University Mainz, Mainz, Rheinland-Pfalz, Germany
  • Matthias F. Baumann Institute of Computer Science, Faculty of Mathematics and Natural Sciences, University of Bonn, Bonn, North Rhine-Westphalia, Germany
  • Finn F. Weiß Institute of Computer Science, Faculty of Physics, Mathematics and Computer Science, Johannes Gutenberg University Mainz, Mainz, Rheinland-Pfalz, Germany

DOI:

https://doi.org/10.66238/smsrj.v4i2.81

Keywords:

Layer-7 load balancing, cost-sensitive routing, bursty traffic, enterprise cloud computing, resource allocation.

Abstract

Modern enterprise cloud environments face significant challenges in managing operational costs while maintaining high quality of service during periods of sudden, unpredictable traffic surges. Traditional Layer-4 network load balancers often lack the application-level awareness required to route requests based on granular resource consumption, whereas standard Layer-7 solutions typically prioritize performance and latency over financial expenditure. This paper investigates a novel paradigm for cost-sensitive Layer-7 load balancing specifically designed to mitigate the financial impact of bursty enterprise cloud traffic conditions. By analyzing incoming HTTP request payloads, headers, and user session data, the proposed architecture dynamically calculates the operational cost associated with fulfilling each request across a heterogeneous pool of backend instances, including on-demand, reserved, and spot virtual machines. The study proposes a comprehensive decision-making framework that continuously ingests real-time pricing metrics, server utilization rates, and application profiling data to perform financially optimized traffic distribution. Through extensive simulation and empirical analysis, this paper demonstrates that integrating cost awareness directly into the application-layer routing logic can yield substantial reductions in overall cloud infrastructure expenditures without inducing unacceptable degradation in user-perceived latency. The findings highlight the critical importance of multidimensional metrics in modern load balancing and provide a robust architectural blueprint for enterprises seeking to balance financial constraints with the computational demands of bursty workloads.

References

1. Wang, H., Wei, W., Wang, K., Kong, H., Zilli Vieira, C.L., Koutrakis, P.,

Huang, S., Xiong, J., and Giorio, C. (2025). A global multidimensional

analysis of air pollution in land, sea, and air transport cabins reveals sub_x0002_stantial health risks. One Earth 8, 101156.

2. Kim, E. H., Huang, H., Wang, Z., Duan, H., Fu, Z., & Pedrycz, W. (2026). Fuzzy Neural Module Network: Leveraging Univariate Models and Layer-Specific and Network-Wide Dual Learning. IEEE Transactions on Cybernetics.

3. Wang, S., Zhang, X., Wang, P., & Li, X. (2026). Design of Magnetic Sensor Array-Based PUFs for IoT Security. IEEE Transactions on Instrumentation and Measurement, 75, 1-9.

4. Wei, Q., Li, R., Bai, W., & Han, Z. (2025). Multi-UAV-enabled energy-efficient data delivery for low-altitude economy: Joint coded caching, user grouping, and UAV deployment. IEEE Internet of Things Journal, 12(14), 27519-27532.

5. Xiao, W., Tan, Q., Chen, M., Yao, Y., & Shu, F. (2026). Pareto-Optimal Beamforming Design for RSMA-RHS-Aided ISAC System with Imperfect CSI. IEEE Transactions on Vehicular Technology.

6. Zhang, Z., Gao, S., Su, S., Sun, L., & Chen, R. (2023). MINING: Multi-granularity network alignment based on contrastive learning. IEEE Transactions on Knowledge and Data Engineering, 35(12), 12785-12798.

7. Pei, Z., Huang, Q., & Wang, S. (2026). When LLMs develop languages: Symbolic communication for efficient multi-agent reasoning. arXiv preprint arXiv:2606.29354.

8. Yang, Z., Ji, W., & Wang, Z. (2024). Adaptive joint configuration optimization for collaborative inference in edge-cloud systems. Science China Information Sciences, 67(4), 149103.

9. Vinyals, O., Fortunato, M., & Jaitly, N. (2015). Pointer networks. In Advances in Neural Information Processing Systems.

10. Yao, Y., Shu, F., Li, Z., Cheng, X., & Wu, L. (2023). Secure transmission scheme based on joint radar and communication in mobile vehicular networks. IEEE transactions on intelligent transportation systems, 24 (9), 10027-10037.

11. Yang, Z., Liang, B., & Ji, W. (2021). An intelligent end–edge–cloud architecture for visual IoT-assisted healthcare systems. IEEE internet of things journal, 8(23), 16779-16786.

12. Li, X., Chen, W., Liu, X., & Ren, M. (2015). A high-order sigma-delta accelerometer interface circuit.IEICE Electronics Express,12(2), 20141035-20141035.

13. Ghemawat, S., Gobioff, H., & Leung, S.-T. (2003). The Google file system. In Proceedings of SOSP.

14. Li, X., Wang, P., Li, G., Ni, L., & Zhang, Y. (2023). Design of interface circuits and lightweight PUF for TMR sensors. IEEE Sensors Journal, 23(11), 11754-11761.

15. Meng, X., & Zhu, L. (2024). Augmenting cybersecurity in smart urban energy systems through IoT and blockchain technology within the Digital Twin framework. Sustainable Cities and Society, 106, 105336.

16. Li, B., Zhang, R., Liang, H., Zhang, J., Zhang, J., Chen, X., ... & Wang, J. (2026). Interagent: Physics-based multi-agent command execution via diffusion on interaction graphs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 15253-15265).

17. Lin, Y., Yao, Y., Zhu, J., & He, C. (2025, July). Application of generative AI in predictive analysis of urban energy distribution and traffic congestion in smart cities. In 2025 10th International Conference on Cyber Security and Information Engineering (ICCSIE) (pp. 620-623). IEEE.

18. Li, X., Wang, P., Li, G., & Zhang, Y. (2023). Design of a novel self-test-on-chip interface ASIC for capacitive accelerometers. IEEE Transactions on Circuits and Systems I: Regular Papers, 70(7), 2834-2843.

19. Wei, M., Li, R., Wang, L., Chang, Z., Xu, L., & Han, Z. (2026). Toward Adaptive Tracking and Communication via an Airborne Maneuverable Bi-Static ISAC System. IEEE Transactions on Vehicular Technology.

20. Wang, M., Li, J., Li, Z., Luo, C., Chen, B., Xia, S. T., & Wang, Z. (2023, October). Unsupervised anomaly detection with local-sensitive VQVAE and global-sensitive transformers. In 2023 IEEE International Conference on Image Processing (ICIP) (pp. 1080-1084). IEEE.

21. Meng, X., & Lin, J. (2026). RAP-VIoT: Resource-adaptive and scalable vision with IoT guidance and traceability. Pattern Recognition, 114530.

22. Zhang, Q., Gao, W., Liu, C., Yao, Y., Yan, S., Shu, F., & Jin, S. (2025). Covert transmission for active RIS-aided full-duplex UAV integrated sensing, communication, and computation systems. IEEE Journal on Selected Areas in Communications.

23. Liu, J., Nazeri, A., Zhao, C., Abuhdima, E., Comert, G., Huang, C. T., & Pisu, P. (2023). Switching strategy for connected vehicles under variant harsh weather conditions. IEEE Journal of Radio Frequency Identification, 7, 371-378.

24. Wu, C., Xu, C., & Liu, Y. (2026). L7-COLO: A Cost-Aware Layer-7 Load Balancing Framework with Deep Traffic Prediction for Dynamic Optimization of Enterprise Cloud Services. Fundamental Scientific Reports in Multidisciplinary Areas, 2(02), 235-249.

25. Corbett, J. C., Dean, J., Epstein, M., Fikes, A., Frost, C., Furman, J. J., et al. (2013). Spanner: Google’s globally-distributed database. ACM Transactions on Computer Systems, 31(3), Article 8.

26. Li, Q., Ye, Q., Zhang, N., Zhang, W., & Hu, F. (2025). Digital-twin-enabled industrial IoT: Vision, framework, and future directions. IEEE Wireless Communications, 32(6), 173-181.

27. Hu, Y., Yang, Z., Zhao, C., & Ji, W. (2026, May). Adaptive guidance semantically enhanced via multimodal llm for edge-cloud object detection. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 12962-12966). IEEE.

Downloads

Published

2026-10-08

Issue

Section

Articles