Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks

H. Afifi, H. Karl, in: 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020), Thessaloniki, Greece, 2020.

Download
No fulltext has been uploaded.
Conference Paper | English
Abstract
Upcoming sensing applications (acoustic or video) will have high processing requirements not satisfiable by a single node or need input from multiple sources (e.g., speaker localization). Offloading these applications to cloud or mobile edge is an option, but when running in a wireless senor network (WSN), it might entail needlessly high data rate and latency. An alternative is to spread processing inside the WSN, which is particularly attractive if the application comprises individual components. This scenario is typical for applications like acoustic signal processing. Mapping components to nodes can be formulated as wireless version of the NP-hard Virtual Network Embedding (VNE) problem, for which various heuristics exist. We propose a Reinforcement Learning (RL) framework, which relies on Q-Learning and uses either Greedy Epsilon or Epsilon Decay for exploration. We compare both exploration methods to the result of an optimization approach and show empirically that the RL framework achieves good results in terms of network delay within few number of steps.
Publishing Year
Proceedings Title
2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob'2020)
LibreCat-ID

Cite this

Afifi H, Karl H. Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks. In: 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020). Thessaloniki, Greece; 2020.
Afifi, H., & Karl, H. (2020). Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks. In 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020). Thessaloniki, Greece.
@inproceedings{Afifi_Karl_2020, place={Thessaloniki, Greece}, title={Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks}, booktitle={2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020)}, author={Afifi, Haitham and Karl, Holger}, year={2020} }
Afifi, Haitham, and Holger Karl. “Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks.” In 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020). Thessaloniki, Greece, 2020.
H. Afifi and H. Karl, “Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks,” in 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020), 2020.
Afifi, Haitham, and Holger Karl. “Reinforcement Learning for Virtual Network Embedding in Wireless Sensor Networks.” 2020 Thirteenth International Workshop on Selected Topics in Mobile and Wireless Computing (STWiMob’2020), 2020.

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar