---
_id: '21479'
abstract:
- lang: eng
  text: Two of the most important metrics when developing Wireless Sensor Networks
    (WSNs) applications are the Quality of Information (QoI) and Quality of Service
    (QoS). The former is used to specify the quality of the collected data by the
    sensors (e.g., measurements error or signal's intensity), while the latter defines
    the network's performance and availability (e.g., packet losses and latency).
    In this paper, we consider an example of wireless acoustic sensor networks, where
    we select a subset of microphones for two different objectives. First, we maximize
    the recording quality under QoS constraints. Second, we apply a trade-off between
    QoI and QoS. We formulate the problem as a constrained Markov Decision Problem
    (MDP) and solve it using reinforcement learning (RL). We compare the RL solution
    to a baseline model and show that in case of QoS-guarantee objective, the RL solution
    has an optimality gap up to 1\%. Meanwhile, the RL solution is better than the
    baseline with improvements up to 23\%, when using the trade-off objective.
author:
- first_name: Haitham
  full_name: Afifi, Haitham
  id: '65718'
  last_name: Afifi
- first_name: Arunselvan
  full_name: Ramaswamy, Arunselvan
  id: '66937'
  last_name: Ramaswamy
  orcid: https://orcid.org/ 0000-0001-7547-8111
- first_name: Holger
  full_name: Karl, Holger
  id: '126'
  last_name: Karl
citation:
  ama: 'Afifi H, Ramaswamy A, Karl H. A Reinforcement Learning QoI/QoS-Aware Approach
    in Acoustic Sensor Networks. In: <i>2021 IEEE 18th Annual Consumer Communications
    \&#38; Networking Conference (CCNC) (CCNC 2021)</i>. ; 2021.'
  apa: Afifi, H., Ramaswamy, A., &#38; Karl, H. (2021). A Reinforcement Learning QoI/QoS-Aware
    Approach in Acoustic Sensor Networks. In <i>2021 IEEE 18th Annual Consumer Communications
    \&#38; Networking Conference (CCNC) (CCNC 2021)</i>.
  bibtex: '@inproceedings{Afifi_Ramaswamy_Karl_2021, title={A Reinforcement Learning
    QoI/QoS-Aware Approach in Acoustic Sensor Networks}, booktitle={2021 IEEE 18th
    Annual Consumer Communications \&#38; Networking Conference (CCNC) (CCNC 2021)},
    author={Afifi, Haitham and Ramaswamy, Arunselvan and Karl, Holger}, year={2021}
    }'
  chicago: Afifi, Haitham, Arunselvan Ramaswamy, and Holger Karl. “A Reinforcement
    Learning QoI/QoS-Aware Approach in Acoustic Sensor Networks.” In <i>2021 IEEE
    18th Annual Consumer Communications \&#38; Networking Conference (CCNC) (CCNC
    2021)</i>, 2021.
  ieee: H. Afifi, A. Ramaswamy, and H. Karl, “A Reinforcement Learning QoI/QoS-Aware
    Approach in Acoustic Sensor Networks,” in <i>2021 IEEE 18th Annual Consumer Communications
    \&#38; Networking Conference (CCNC) (CCNC 2021)</i>, 2021.
  mla: Afifi, Haitham, et al. “A Reinforcement Learning QoI/QoS-Aware Approach in
    Acoustic Sensor Networks.” <i>2021 IEEE 18th Annual Consumer Communications \&#38;
    Networking Conference (CCNC) (CCNC 2021)</i>, 2021.
  short: 'H. Afifi, A. Ramaswamy, H. Karl, in: 2021 IEEE 18th Annual Consumer Communications
    \&#38; Networking Conference (CCNC) (CCNC 2021), 2021.'
date_created: 2021-03-12T16:03:53Z
date_updated: 2022-01-06T06:55:00Z
keyword:
- reinforcement learning
- wireless sensor networks
- resource allocation
- acoustic sensor networks
language:
- iso: eng
project:
- _id: '27'
  name: Akustische Sensornetzwerke - Teilprojekt "Verteilte akustische Signalverarbeitung
    über funkbasierte Sensornetzwerke
publication: 2021 IEEE 18th Annual Consumer Communications \& Networking Conference
  (CCNC) (CCNC 2021)
status: public
title: A Reinforcement Learning QoI/QoS-Aware Approach in Acoustic Sensor Networks
type: conference
user_id: '65718'
year: '2021'
...
---
_id: '10646'
author:
- first_name: Klaus
  full_name: Danne, Klaus
  last_name: Danne
- first_name: Roland
  full_name: Mühlenbernd, Roland
  last_name: Mühlenbernd
- first_name: Marco
  full_name: Platzner, Marco
  id: '398'
  last_name: Platzner
citation:
  ama: Danne K, Mühlenbernd R, Platzner M. Server-based execution of periodic tasks
    on dynamically reconfigurable hardware. <i>IET Computers Digital Techniques</i>.
    2007;1(4):295-302. doi:<a href="https://doi.org/10.1049/iet-cdt:20060186">10.1049/iet-cdt:20060186</a>
  apa: Danne, K., Mühlenbernd, R., &#38; Platzner, M. (2007). Server-based execution
    of periodic tasks on dynamically reconfigurable hardware. <i>IET Computers Digital
    Techniques</i>, <i>1</i>(4), 295–302. <a href="https://doi.org/10.1049/iet-cdt:20060186">https://doi.org/10.1049/iet-cdt:20060186</a>
  bibtex: '@article{Danne_Mühlenbernd_Platzner_2007, title={Server-based execution
    of periodic tasks on dynamically reconfigurable hardware}, volume={1}, DOI={<a
    href="https://doi.org/10.1049/iet-cdt:20060186">10.1049/iet-cdt:20060186</a>},
    number={4}, journal={IET Computers Digital Techniques}, author={Danne, Klaus and
    Mühlenbernd, Roland and Platzner, Marco}, year={2007}, pages={295–302} }'
  chicago: 'Danne, Klaus, Roland Mühlenbernd, and Marco Platzner. “Server-Based Execution
    of Periodic Tasks on Dynamically Reconfigurable Hardware.” <i>IET Computers Digital
    Techniques</i> 1, no. 4 (2007): 295–302. <a href="https://doi.org/10.1049/iet-cdt:20060186">https://doi.org/10.1049/iet-cdt:20060186</a>.'
  ieee: K. Danne, R. Mühlenbernd, and M. Platzner, “Server-based execution of periodic
    tasks on dynamically reconfigurable hardware,” <i>IET Computers Digital Techniques</i>,
    vol. 1, no. 4, pp. 295–302, 2007.
  mla: Danne, Klaus, et al. “Server-Based Execution of Periodic Tasks on Dynamically
    Reconfigurable Hardware.” <i>IET Computers Digital Techniques</i>, vol. 1, no.
    4, 2007, pp. 295–302, doi:<a href="https://doi.org/10.1049/iet-cdt:20060186">10.1049/iet-cdt:20060186</a>.
  short: K. Danne, R. Mühlenbernd, M. Platzner, IET Computers Digital Techniques 1
    (2007) 295–302.
date_created: 2019-07-10T11:10:54Z
date_updated: 2022-01-06T06:50:49Z
department:
- _id: '78'
doi: 10.1049/iet-cdt:20060186
intvolume: '         1'
issue: '4'
keyword:
- reconfigurable architectures
- resource allocation
- device reconfiguration time
- dynamic hardware reconfiguration
- dynamically reconfigurable hardware
- light-weight runtime system
- merge server distribute load
- periodic real-time tasks
- runtime system overheads
- schedulability analysis
- scheduling technique
- server-based execution
- synthesis tool flow
language:
- iso: eng
page: 295-302
publication: IET Computers Digital Techniques
publication_identifier:
  issn:
  - 1751-8601
status: public
title: Server-based execution of periodic tasks on dynamically reconfigurable hardware
type: journal_article
user_id: '3118'
volume: 1
year: '2007'
...