Learning Coflow Admissions

A. Hasnain, H. Karl, in: IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), IEEE Communications Society, n.d.

Download
OA 456.32 KB
Conference Paper | Accepted | English
Department
Abstract
Data-parallel applications are developed using different data programming models, e.g., MapReduce, partition/aggregate. These models represent diverse resource requirements of application in a datacenter network, which can be represented by the coflow abstraction. The conventional method of creating hand-crafted coflow heuristics for admission or scheduling for different workloads is practically infeasible. In this paper, we propose a deep reinforcement learning (DRL)-based coflow admission scheme -- LCS -- that can learn an admission policy for a higher-level performance objective, i.e., maximize successful coflow admissions, without manual feature engineering. LCS is trained on a production trace, which has online coflow arrivals. The evaluation results show that LCS is able to learn a reasonable admission policy that admits more coflows than state-of-the-art Varys heuristic while meeting their deadlines.
Publishing Year
Proceedings Title
IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)
Conference
IEEE INFOCOM 2021 - IEEE Conference on Computer Communications
Conference Location
Vancouver BC Canada
Conference Date
2021-05-10 – 2021-05-13
LibreCat-ID

Cite this

Hasnain A, Karl H. Learning Coflow Admissions. In: IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE Communications Society.
Hasnain, A., & Karl, H. (n.d.). Learning Coflow Admissions. In IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). Vancouver BC Canada: IEEE Communications Society.
@inproceedings{Hasnain_Karl, title={Learning Coflow Admissions}, booktitle={IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)}, publisher={IEEE Communications Society}, author={Hasnain, Asif and Karl, Holger} }
Hasnain, Asif, and Holger Karl. “Learning Coflow Admissions.” In IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE Communications Society, n.d.
A. Hasnain and H. Karl, “Learning Coflow Admissions,” in IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Vancouver BC Canada.
Hasnain, Asif, and Holger Karl. “Learning Coflow Admissions.” IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), IEEE Communications Society.
Main File(s)
File Name
File Title
Learning Coflow Admissions
Access Level
OA Open Access
Last Uploaded
2021-01-26T20:19:15Z


Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar