Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling
K. Razavi, S. Ghafouri, M. Mühlhäuser, P. Jamshidi, L. Wang, in: Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), Colocated with EuroSys 2024, ACM, 2024.
Download
No fulltext has been uploaded.
Conference Paper
| English
Author
Razavi, Kamran;
Ghafouri, Saeid;
Mühlhäuser, Max;
Jamshidi, Pooyan;
Wang, LinLibreCat
Department
Publishing Year
Proceedings Title
Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), colocated with EuroSys 2024
Conference
4th Workshop on Machine Learning and Systems (EuroMLSys), colocated with EuroSys 2024
Conference Location
Athens, Greece
Conference Date
2024-04-22 – 2024-04-22
LibreCat-ID
Cite this
Razavi K, Ghafouri S, Mühlhäuser M, Jamshidi P, Wang L. Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling. In: Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), Colocated with EuroSys 2024. ACM; 2024. doi:10.1145/3642970.365583
Razavi, K., Ghafouri, S., Mühlhäuser, M., Jamshidi, P., & Wang, L. (2024). Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling. Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), Colocated with EuroSys 2024. 4th Workshop on Machine Learning and Systems (EuroMLSys), colocated with EuroSys 2024, Athens, Greece. https://doi.org/10.1145/3642970.365583
@inproceedings{Razavi_Ghafouri_Mühlhäuser_Jamshidi_Wang_2024, title={Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling}, DOI={10.1145/3642970.365583}, booktitle={Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), colocated with EuroSys 2024}, publisher={ACM}, author={Razavi, Kamran and Ghafouri, Saeid and Mühlhäuser, Max and Jamshidi, Pooyan and Wang, Lin}, year={2024} }
Razavi, Kamran, Saeid Ghafouri, Max Mühlhäuser, Pooyan Jamshidi, and Lin Wang. “Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling.” In Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), Colocated with EuroSys 2024. ACM, 2024. https://doi.org/10.1145/3642970.365583.
K. Razavi, S. Ghafouri, M. Mühlhäuser, P. Jamshidi, and L. Wang, “Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling,” presented at the 4th Workshop on Machine Learning and Systems (EuroMLSys), colocated with EuroSys 2024, Athens, Greece, 2024, doi: 10.1145/3642970.365583.
Razavi, Kamran, et al. “Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling.” Proceedings of the 4th Workshop on Machine Learning and Systems (EuroMLSys), Colocated with EuroSys 2024, ACM, 2024, doi:10.1145/3642970.365583.
Google Scholar