Self-Driving Network and Service Coordination Using Deep Reinforcement Learning

S.B. Schneider, A. Manzoor, H. Qarawlus, R. Schellenberg, H. Karl, R. Khalili, A. Hecker, in: IEEE International Conference on Network and Service Management (CNSM), IEEE, 2020.

Download
OA 643.00 KB
Conference Paper | English
Author
; ; ; ; ; ;
Department
Abstract
Modern services comprise interconnected components, e.g., microservices in a service mesh, that can scale and run on multiple nodes across the network on demand. To process incoming traffic, service components have to be instantiated and traffic assigned to these instances, taking capacities and changing demands into account. This challenge is usually solved with custom approaches designed by experts. While this typically works well for the considered scenario, the models often rely on unrealistic assumptions or on knowledge that is not available in practice (e.g., a priori knowledge). We propose a novel deep reinforcement learning approach that learns how to best coordinate services and is geared towards realistic assumptions. It interacts with the network and relies on available, possibly delayed monitoring information. Rather than defining a complex model or an algorithm how to achieve an objective, our model-free approach adapts to various objectives and traffic patterns. An agent is trained offline without expert knowledge and then applied online with minimal overhead. Compared to a state-of-the-art heuristic, it significantly improves flow throughput and overall network utility on real-world network topologies and traffic traces. It also learns to optimize different objectives, generalizes to scenarios with unseen, stochastic traffic patterns, and scales to large real-world networks.
Publishing Year
Proceedings Title
IEEE International Conference on Network and Service Management (CNSM)
LibreCat-ID

Cite this

Schneider SB, Manzoor A, Qarawlus H, et al. Self-Driving Network and Service Coordination Using Deep Reinforcement Learning. In: IEEE International Conference on Network and Service Management (CNSM). IEEE; 2020.
Schneider, S. B., Manzoor, A., Qarawlus, H., Schellenberg, R., Karl, H., Khalili, R., & Hecker, A. (2020). Self-Driving Network and Service Coordination Using Deep Reinforcement Learning. In IEEE International Conference on Network and Service Management (CNSM). IEEE.
@inproceedings{Schneider_Manzoor_Qarawlus_Schellenberg_Karl_Khalili_Hecker_2020, title={Self-Driving Network and Service Coordination Using Deep Reinforcement Learning}, booktitle={IEEE International Conference on Network and Service Management (CNSM)}, publisher={IEEE}, author={Schneider, Stefan Balthasar and Manzoor, Adnan and Qarawlus, Haydar and Schellenberg, Rafael and Karl, Holger and Khalili, Ramin and Hecker, Artur}, year={2020} }
Schneider, Stefan Balthasar, Adnan Manzoor, Haydar Qarawlus, Rafael Schellenberg, Holger Karl, Ramin Khalili, and Artur Hecker. “Self-Driving Network and Service Coordination Using Deep Reinforcement Learning.” In IEEE International Conference on Network and Service Management (CNSM). IEEE, 2020.
S. B. Schneider et al., “Self-Driving Network and Service Coordination Using Deep Reinforcement Learning,” in IEEE International Conference on Network and Service Management (CNSM), 2020.
Schneider, Stefan Balthasar, et al. “Self-Driving Network and Service Coordination Using Deep Reinforcement Learning.” IEEE International Conference on Network and Service Management (CNSM), IEEE, 2020.
Main File(s)
File Name
Access Level
OA Open Access
Last Uploaded
2020-09-22T06:36:00Z


Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar