{"_id":"34072","language":[{"iso":"eng"}],"author":[{"id":"34851","full_name":"Ebbers, Janek","last_name":"Ebbers","first_name":"Janek"},{"id":"242","first_name":"Reinhold","last_name":"Haeb-Umbach","full_name":"Haeb-Umbach, Reinhold"},{"first_name":"Romain","full_name":"Serizel, Romain","last_name":"Serizel"}],"year":"2022","oa":"1","file":[{"file_id":"34073","file_name":"Template.pdf","content_type":"application/pdf","file_size":214001,"access_level":"open_access","relation":"main_file","creator":"ebbers","date_updated":"2022-11-14T12:19:55Z","date_created":"2022-11-14T12:19:55Z"}],"citation":{"ama":"Ebbers J, Haeb-Umbach R, Serizel R. Threshold Independent Evaluation of Sound Event Detection Scores. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). ; 2022.","chicago":"Ebbers, Janek, Reinhold Haeb-Umbach, and Romain Serizel. “Threshold Independent Evaluation of Sound Event Detection Scores.” In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.","short":"J. Ebbers, R. Haeb-Umbach, R. Serizel, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.","mla":"Ebbers, Janek, et al. “Threshold Independent Evaluation of Sound Event Detection Scores.” Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.","apa":"Ebbers, J., Haeb-Umbach, R., & Serizel, R. (2022). Threshold Independent Evaluation of Sound Event Detection Scores. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).","bibtex":"@inproceedings{Ebbers_Haeb-Umbach_Serizel_2022, title={Threshold Independent Evaluation of Sound Event Detection Scores}, booktitle={Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, author={Ebbers, Janek and Haeb-Umbach, Reinhold and Serizel, Romain}, year={2022} }","ieee":"J. Ebbers, R. Haeb-Umbach, and R. Serizel, “Threshold Independent Evaluation of Sound Event Detection Scores,” 2022."},"has_accepted_license":"1","user_id":"34851","date_created":"2022-11-14T12:17:03Z","abstract":[{"text":"Performing an adequate evaluation of sound event detection (SED) systems is far from trivial and is still subject to ongoing research. The recently proposed polyphonic sound detection (PSD)-receiver operating characteristic (ROC) and PSD score (PSDS) make an important step into the direction of an evaluation of SED systems which is independent from a certain decision threshold. This allows to obtain a more complete picture of the overall system behavior which is less biased by threshold tuning. Yet, the PSD-ROC is currently only approximated using a finite set of thresholds. The choice of\r\nthe thresholds used in approximation, however, can have a severe impact on the resulting PSDS. In this paper we propose a method which allows for computing system performance on an evaluation set for all possible thresholds jointly, enabling accurate computation not only of the PSD-ROC and PSDS but also of other collar-based\r\nand intersection-based performance curves. It further allows to select the threshold which best fulfills the requirements of a given application. Source code is publicly available in our SED evaluation package sed_scores_eval.","lang":"eng"}],"ddc":["000"],"status":"public","publication":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","date_updated":"2023-11-22T08:26:58Z","department":[{"_id":"54"}],"title":"Threshold Independent Evaluation of Sound Event Detection Scores","quality_controlled":"1","type":"conference","file_date_updated":"2022-11-14T12:19:55Z"}