Integration neural network based beamforming and weighted prediction error dereverberation
L. Drude, C. Boeddeker, J. Heymann, K. Kinoshita, M. Delcroix, T. Nakatani, R. Haeb-Umbach, in: INTERSPEECH 2018, Hyderabad, India, 2018.
Conference Paper
| English
Author
Drude, LukasLibreCat;
Boeddeker, ChristophLibreCat;
Heymann, JahnLibreCat;
Kinoshita, Keisuke;
Delcroix, Marc;
Nakatani, Tomohiro;
Haeb-Umbach, ReinholdLibreCat
Abstract
The weighted prediction error (WPE) algorithm has proven to be a very successful dereverberation method for the REVERB challenge. Likewise, neural network based mask estimation for beamforming demonstrated very good noise suppression in the CHiME 3 and CHiME 4 challenges. Recently, it has been shown that this estimator can also be trained to perform dereverberation and denoising jointly. However, up to now a comparison of a neural beamformer and WPE is still missing, so is an investigation into a combination of the two. Therefore, we here provide an extensive evaluation of both and consequently propose variants to integrate deep neural network based beamforming with WPE. For these integrated variants we identify a consistent word error rate (WER) reduction on two distinct databases. In particular, our study shows that deep learning based beamforming benefits from a model-based dereverberation technique (i.e. WPE) and vice versa. Our key findings are: (a) Neural beamforming yields the lower WERs in comparison to WPE the more channels and noise are present. (b) Integration of WPE and a neural beamformer consistently outperforms all stand-alone systems.
Publishing Year
Proceedings Title
INTERSPEECH 2018, Hyderabad, India
LibreCat-ID
Cite this
Drude L, Boeddeker C, Heymann J, et al. Integration neural network based beamforming and weighted prediction error dereverberation. In: INTERSPEECH 2018, Hyderabad, India. ; 2018.
Drude, L., Boeddeker, C., Heymann, J., Kinoshita, K., Delcroix, M., Nakatani, T., & Haeb-Umbach, R. (2018). Integration neural network based beamforming and weighted prediction error dereverberation. In INTERSPEECH 2018, Hyderabad, India.
@inproceedings{Drude_Boeddeker_Heymann_Kinoshita_Delcroix_Nakatani_Haeb-Umbach_2018, title={Integration neural network based beamforming and weighted prediction error dereverberation}, booktitle={INTERSPEECH 2018, Hyderabad, India}, author={Drude, Lukas and Boeddeker, Christoph and Heymann, Jahn and Kinoshita, Keisuke and Delcroix, Marc and Nakatani, Tomohiro and Haeb-Umbach, Reinhold}, year={2018} }
Drude, Lukas, Christoph Boeddeker, Jahn Heymann, Keisuke Kinoshita, Marc Delcroix, Tomohiro Nakatani, and Reinhold Haeb-Umbach. “Integration Neural Network Based Beamforming and Weighted Prediction Error Dereverberation.” In INTERSPEECH 2018, Hyderabad, India, 2018.
L. Drude et al., “Integration neural network based beamforming and weighted prediction error dereverberation,” in INTERSPEECH 2018, Hyderabad, India, 2018.
Drude, Lukas, et al. “Integration Neural Network Based Beamforming and Weighted Prediction Error Dereverberation.” INTERSPEECH 2018, Hyderabad, India, 2018.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Link(s) to Main File(s)
Access Level
Closed Access
External material:
Supplementary Material
Description
Slides
Google Scholar