{"ddc":["000"],"abstract":[{"text":"Performing an adequate evaluation of sound event detection (SED) systems is far from trivial and is still subject to ongoing research. The recently proposed polyphonic sound detection (PSD)-receiver operating characteristic (ROC) and PSD score (PSDS) make an important step into the direction of an evaluation of SED systems which is independent from a certain decision threshold. This allows to obtain a more complete picture of the overall system behavior which is less biased by threshold tuning. Yet, the PSD-ROC is currently only approximated using a finite set of thresholds. The choice of\r\nthe thresholds used in approximation, however, can have a severe impact on the resulting PSDS. In this paper we propose a method which allows for computing system performance on an evaluation set for all possible thresholds jointly, enabling accurate computation not only of the PSD-ROC and PSDS but also of other collar-based\r\nand intersection-based performance curves. It further allows to select the threshold which best fulfills the requirements of a given application. Source code is publicly available in our SED evaluation package sed_scores_eval.","lang":"eng"}],"file":[{"file_size":214001,"date_updated":"2022-11-14T12:19:55Z","file_name":"Template.pdf","creator":"ebbers","content_type":"application/pdf","relation":"main_file","access_level":"open_access","file_id":"34073","date_created":"2022-11-14T12:19:55Z"}],"department":[{"_id":"54"}],"user_id":"34851","oa":"1","citation":{"short":"J. Ebbers, R. Haeb-Umbach, R. Serizel, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.","chicago":"Ebbers, Janek, Reinhold Haeb-Umbach, and Romain Serizel. “Threshold Independent Evaluation of Sound Event Detection Scores.” In <i>Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)</i>, 2022.","bibtex":"@inproceedings{Ebbers_Haeb-Umbach_Serizel_2022, title={Threshold Independent Evaluation of Sound Event Detection Scores}, booktitle={Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, author={Ebbers, Janek and Haeb-Umbach, Reinhold and Serizel, Romain}, year={2022} }","ama":"Ebbers J, Haeb-Umbach R, Serizel R. Threshold Independent Evaluation of Sound Event Detection Scores. In: <i>Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)</i>. ; 2022.","mla":"Ebbers, Janek, et al. “Threshold Independent Evaluation of Sound Event Detection Scores.” <i>Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)</i>, 2022.","ieee":"J. Ebbers, R. Haeb-Umbach, and R. Serizel, “Threshold Independent Evaluation of Sound Event Detection Scores,” 2022.","apa":"Ebbers, J., Haeb-Umbach, R., &#38; Serizel, R. (2022). Threshold Independent Evaluation of Sound Event Detection Scores. <i>Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)</i>."},"file_date_updated":"2022-11-14T12:19:55Z","type":"conference","date_created":"2022-11-14T12:17:03Z","title":"Threshold Independent Evaluation of Sound Event Detection Scores","publication":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":[{"last_name":"Ebbers","full_name":"Ebbers, Janek","first_name":"Janek","id":"34851"},{"id":"242","first_name":"Reinhold","last_name":"Haeb-Umbach","full_name":"Haeb-Umbach, Reinhold"},{"first_name":"Romain","last_name":"Serizel","full_name":"Serizel, Romain"}],"status":"public","has_accepted_license":"1","date_updated":"2023-11-22T08:26:58Z","year":"2022","quality_controlled":"1","_id":"34072","language":[{"iso":"eng"}]}