---
_id: '61041'
abstract:
- lang: eng
text: Large Language Models (LLMs) are increasingly deployed in real-world applications
that require access to up-to-date knowledge. However, retraining LLMs is computationally
expensive. Therefore, knowledge editing techniques are crucial for maintaining
current information and correcting erroneous assertions within pre-trained models.
Current benchmarks for knowledge editing primarily focus on recalling edited facts,
often neglecting their logical consequences. To address this limitation, we introduce
a new benchmark designed to evaluate how knowledge editing methods handle the
logical consequences of a single fact edit. Our benchmark extracts relevant logical
rules from a knowledge graph for a given edit. Then, it generates multi-hop questions
based on these rules to assess the impact on logical consequences. Our findings
indicate that while existing knowledge editing approaches can accurately insert
direct assertions into LLMs, they frequently fail to inject entailed knowledge.
Specifically, experiments with popular methods like ROME and FT reveal a substantial
performance gap, up to 24%, between evaluations on directly edited knowledge and
on entailed knowledge. This highlights the critical need for semantics-aware evaluation
frameworks in knowledge editing.
author:
- first_name: Tatiana
full_name: Moteu Ngoli, Tatiana
id: '99174'
last_name: Moteu Ngoli
- first_name: N'Dah Jean
full_name: Kouagou, N'Dah Jean
id: '87189'
last_name: Kouagou
- first_name: Hamada Mohamed Abdelsamee
full_name: Zahera, Hamada Mohamed Abdelsamee
id: '72768'
last_name: Zahera
orcid: 0000-0003-0215-1278
- first_name: Axel-Cyrille
full_name: Ngonga Ngomo, Axel-Cyrille
id: '65716'
last_name: Ngonga Ngomo
citation:
ama: 'Moteu Ngoli T, Kouagou NJ, Zahera HMA, Ngonga Ngomo A-C. Benchmarking Knowledge
Editing using Logical Rules. In: Proceedings of the 24th International Semantic
Web Conference (ISWC 2025). Springer, Cham; 2025:pp 41-56. doi:https://doi.org/10.1007/978-3-032-09530-5_3'
apa: Moteu Ngoli, T., Kouagou, N. J., Zahera, H. M. A., & Ngonga Ngomo, A.-C.
(2025). Benchmarking Knowledge Editing using Logical Rules. Proceedings of
the 24th International Semantic Web Conference (ISWC 2025), pp 41-56. https://doi.org/10.1007/978-3-032-09530-5_3
bibtex: '@inproceedings{Moteu Ngoli_Kouagou_Zahera_Ngonga Ngomo_2025, title={Benchmarking
Knowledge Editing using Logical Rules}, DOI={https://doi.org/10.1007/978-3-032-09530-5_3},
booktitle={Proceedings of the 24th International Semantic Web Conference (ISWC
2025)}, publisher={Springer, Cham}, author={Moteu Ngoli, Tatiana and Kouagou,
N’Dah Jean and Zahera, Hamada Mohamed Abdelsamee and Ngonga Ngomo, Axel-Cyrille},
year={2025}, pages={pp 41-56} }'
chicago: Moteu Ngoli, Tatiana, N’Dah Jean Kouagou, Hamada Mohamed Abdelsamee Zahera,
and Axel-Cyrille Ngonga Ngomo. “Benchmarking Knowledge Editing Using Logical Rules.”
In Proceedings of the 24th International Semantic Web Conference (ISWC 2025),
pp 41-56. Springer, Cham, 2025. https://doi.org/10.1007/978-3-032-09530-5_3.
ieee: 'T. Moteu Ngoli, N. J. Kouagou, H. M. A. Zahera, and A.-C. Ngonga Ngomo, “Benchmarking
Knowledge Editing using Logical Rules,” in Proceedings of the 24th International
Semantic Web Conference (ISWC 2025), Nara, Japan, 2025, p. pp 41-56, doi:
https://doi.org/10.1007/978-3-032-09530-5_3.'
mla: Moteu Ngoli, Tatiana, et al. “Benchmarking Knowledge Editing Using Logical
Rules.” Proceedings of the 24th International Semantic Web Conference (ISWC
2025), Springer, Cham, 2025, p. pp 41-56, doi:https://doi.org/10.1007/978-3-032-09530-5_3.
short: 'T. Moteu Ngoli, N.J. Kouagou, H.M.A. Zahera, A.-C. Ngonga Ngomo, in: Proceedings
of the 24th International Semantic Web Conference (ISWC 2025), Springer, Cham,
2025, p. pp 41-56.'
conference:
end_date: 2025.11.6
location: Nara, Japan
name: The 24th International Semantic Web Conference (ISWC 2025)
start_date: 2025.11.2
date_created: 2025-08-27T13:17:55Z
date_updated: 2025-12-01T10:04:25Z
department:
- _id: '574'
doi: https://doi.org/10.1007/978-3-032-09530-5_3
keyword:
- dice sailproject moteu kouagou zahera ngonga
language:
- iso: eng
page: pp 41-56
project:
- _id: '285'
name: SAIL - Nachhaltiger Lebenszyklus von intelligenten soziotechnischen Systemen
publication: Proceedings of the 24th International Semantic Web Conference (ISWC 2025)
publication_identifier:
isbn:
- 978-3-032-09530-5
publication_status: published
publisher: Springer, Cham
status: public
title: Benchmarking Knowledge Editing using Logical Rules
type: conference
user_id: '99174'
year: '2025'
...
---
_id: '61753'
abstract:
- lang: eng
text: This paper presents LOLA, a massively multilingual large language model trained
on more than 160 languages using a sparse Mixture-of-Experts Transformer architecture.
Our architectural and implementation choices address the challenge of harnessing
linguistic diversity while maintaining efficiency and avoiding the common pitfalls
of multilinguality. Our analysis of the evaluation results shows competitive performance
in natural language generation and understanding tasks. Additionally, we demonstrate
how the learned expert-routing mechanism exploits implicit phylogenetic linguistic
patterns to potentially alleviate the curse of multilinguality. We provide an
in-depth look at the training process, an analysis of the datasets, and a balanced
exploration of the model{’}s strengths and limitations. As an open-source model,
LOLA promotes reproducibility and serves as a robust foundation for future research.
Our findings enable the development of compute-efficient multilingual models with
strong, scalable performance across languages.
author:
- first_name: Nikit
full_name: Srivastava, Nikit
id: '70066'
last_name: Srivastava
orcid: 0009-0004-5164-4911
- first_name: Denis
full_name: Kuchelev, Denis
id: '70842'
last_name: Kuchelev
- first_name: Tatiana
full_name: Moteu Ngoli, Tatiana
id: '99174'
last_name: Moteu Ngoli
- first_name: Kshitij
full_name: Shetty, Kshitij
last_name: Shetty
- first_name: Michael
full_name: Röder, Michael
id: '67199'
last_name: Röder
orcid: https://orcid.org/0000-0002-8609-8277
- first_name: Hamada Mohamed Abdelsamee
full_name: Zahera, Hamada Mohamed Abdelsamee
id: '72768'
last_name: Zahera
orcid: 0000-0003-0215-1278
- first_name: Diego
full_name: Moussallem, Diego
id: '71635'
last_name: Moussallem
- first_name: Axel-Cyrille
full_name: Ngonga Ngomo, Axel-Cyrille
id: '65716'
last_name: Ngonga Ngomo
citation:
ama: 'Srivastava N, Kuchelev D, Moteu Ngoli T, et al. LOLA – An Open-Source Massively
Multilingual Large Language Model. In: Rambow O, Wanner L, Apidianaki M, Al-Khalifa
H, Eugenio BD, Schockaert S, eds. Proceedings of the 31st International Conference
on Computational Linguistics. Association for Computational Linguistics; 2025:6420–6446.'
apa: Srivastava, N., Kuchelev, D., Moteu Ngoli, T., Shetty, K., Röder, M., Zahera,
H. M. A., Moussallem, D., & Ngonga Ngomo, A.-C. (2025). LOLA – An Open-Source
Massively Multilingual Large Language Model. In O. Rambow, L. Wanner, M. Apidianaki,
H. Al-Khalifa, B. D. Eugenio, & S. Schockaert (Eds.), Proceedings of the
31st International Conference on Computational Linguistics (pp. 6420–6446).
Association for Computational Linguistics.
bibtex: '@inproceedings{Srivastava_Kuchelev_Moteu Ngoli_Shetty_Röder_Zahera_Moussallem_Ngonga
Ngomo_2025, place={Abu Dhabi, UAE}, title={LOLA – An Open-Source Massively Multilingual
Large Language Model}, booktitle={Proceedings of the 31st International Conference
on Computational Linguistics}, publisher={Association for Computational Linguistics},
author={Srivastava, Nikit and Kuchelev, Denis and Moteu Ngoli, Tatiana and Shetty,
Kshitij and Röder, Michael and Zahera, Hamada Mohamed Abdelsamee and Moussallem,
Diego and Ngonga Ngomo, Axel-Cyrille}, editor={Rambow, Owen and Wanner, Leo and
Apidianaki, Marianna and Al-Khalifa, Hend and Eugenio, Barbara Di and Schockaert,
Steven}, year={2025}, pages={6420–6446} }'
chicago: 'Srivastava, Nikit, Denis Kuchelev, Tatiana Moteu Ngoli, Kshitij Shetty,
Michael Röder, Hamada Mohamed Abdelsamee Zahera, Diego Moussallem, and Axel-Cyrille
Ngonga Ngomo. “LOLA – An Open-Source Massively Multilingual Large Language Model.”
In Proceedings of the 31st International Conference on Computational Linguistics,
edited by Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara
Di Eugenio, and Steven Schockaert, 6420–6446. Abu Dhabi, UAE: Association for
Computational Linguistics, 2025.'
ieee: N. Srivastava et al., “LOLA – An Open-Source Massively Multilingual
Large Language Model,” in Proceedings of the 31st International Conference
on Computational Linguistics, 2025, pp. 6420–6446.
mla: Srivastava, Nikit, et al. “LOLA – An Open-Source Massively Multilingual Large
Language Model.” Proceedings of the 31st International Conference on Computational
Linguistics, edited by Owen Rambow et al., Association for Computational Linguistics,
2025, pp. 6420–6446.
short: 'N. Srivastava, D. Kuchelev, T. Moteu Ngoli, K. Shetty, M. Röder, H.M.A.
Zahera, D. Moussallem, A.-C. Ngonga Ngomo, in: O. Rambow, L. Wanner, M. Apidianaki,
H. Al-Khalifa, B.D. Eugenio, S. Schockaert (Eds.), Proceedings of the 31st International
Conference on Computational Linguistics, Association for Computational Linguistics,
Abu Dhabi, UAE, 2025, pp. 6420–6446.'
date_created: 2025-10-08T11:02:30Z
date_updated: 2026-01-06T10:11:37Z
editor:
- first_name: Owen
full_name: Rambow, Owen
last_name: Rambow
- first_name: Leo
full_name: Wanner, Leo
last_name: Wanner
- first_name: Marianna
full_name: Apidianaki, Marianna
last_name: Apidianaki
- first_name: Hend
full_name: Al-Khalifa, Hend
last_name: Al-Khalifa
- first_name: Barbara Di
full_name: Eugenio, Barbara Di
last_name: Eugenio
- first_name: Steven
full_name: Schockaert, Steven
last_name: Schockaert
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://aclanthology.org/2025.coling-main.428.pdf
oa: '1'
page: 6420–6446
place: Abu Dhabi, UAE
publication: Proceedings of the 31st International Conference on Computational Linguistics
publisher: Association for Computational Linguistics
status: public
title: LOLA – An Open-Source Massively Multilingual Large Language Model
type: conference
user_id: '70066'
year: '2025'
...
---
_id: '57278'
author:
- first_name: Ana Alexandra
full_name: Morim da Silva, Ana Alexandra
id: '72108'
last_name: Morim da Silva
- first_name: Nikit
full_name: Srivastava, Nikit
id: '70066'
last_name: Srivastava
orcid: 0009-0004-5164-4911
- first_name: Tatiana
full_name: Moteu Ngoli, Tatiana
id: '99174'
last_name: Moteu Ngoli
- first_name: Michael
full_name: Röder, Michael
id: '67199'
last_name: Röder
orcid: https://orcid.org/0000-0002-8609-8277
- first_name: Diego
full_name: Moussallem, Diego
id: '71635'
last_name: Moussallem
- first_name: Axel-Cyrille
full_name: Ngonga Ngomo, Axel-Cyrille
id: '65716'
last_name: Ngonga Ngomo
citation:
ama: 'Morim da Silva AA, Srivastava N, Moteu Ngoli T, Röder M, Moussallem D, Ngonga
Ngomo A-C. Benchmarking Low-Resource Machine Translation Systems. In: Proceedings
of the Seventh Workshop on Technologies for Machine Translation of Low-Resource
Languages (LoResMT 2024). Association for Computational Linguistics; 2024.
doi:10.18653/v1/2024.loresmt-1.18'
apa: Morim da Silva, A. A., Srivastava, N., Moteu Ngoli, T., Röder, M., Moussallem,
D., & Ngonga Ngomo, A.-C. (2024). Benchmarking Low-Resource Machine Translation
Systems. Proceedings of the Seventh Workshop on Technologies for Machine Translation
of Low-Resource Languages (LoResMT 2024). https://doi.org/10.18653/v1/2024.loresmt-1.18
bibtex: '@inproceedings{Morim da Silva_Srivastava_Moteu Ngoli_Röder_Moussallem_Ngonga
Ngomo_2024, title={Benchmarking Low-Resource Machine Translation Systems}, DOI={10.18653/v1/2024.loresmt-1.18},
booktitle={Proceedings of the Seventh Workshop on Technologies for Machine Translation
of Low-Resource Languages (LoResMT 2024)}, publisher={Association for Computational
Linguistics}, author={Morim da Silva, Ana Alexandra and Srivastava, Nikit and
Moteu Ngoli, Tatiana and Röder, Michael and Moussallem, Diego and Ngonga Ngomo,
Axel-Cyrille}, year={2024} }'
chicago: Morim da Silva, Ana Alexandra, Nikit Srivastava, Tatiana Moteu Ngoli, Michael
Röder, Diego Moussallem, and Axel-Cyrille Ngonga Ngomo. “Benchmarking Low-Resource
Machine Translation Systems.” In Proceedings of the Seventh Workshop on Technologies
for Machine Translation of Low-Resource Languages (LoResMT 2024). Association
for Computational Linguistics, 2024. https://doi.org/10.18653/v1/2024.loresmt-1.18.
ieee: 'A. A. Morim da Silva, N. Srivastava, T. Moteu Ngoli, M. Röder, D. Moussallem,
and A.-C. Ngonga Ngomo, “Benchmarking Low-Resource Machine Translation Systems,”
2024, doi: 10.18653/v1/2024.loresmt-1.18.'
mla: Morim da Silva, Ana Alexandra, et al. “Benchmarking Low-Resource Machine Translation
Systems.” Proceedings of the Seventh Workshop on Technologies for Machine Translation
of Low-Resource Languages (LoResMT 2024), Association for Computational Linguistics,
2024, doi:10.18653/v1/2024.loresmt-1.18.
short: 'A.A. Morim da Silva, N. Srivastava, T. Moteu Ngoli, M. Röder, D. Moussallem,
A.-C. Ngonga Ngomo, in: Proceedings of the Seventh Workshop on Technologies for
Machine Translation of Low-Resource Languages (LoResMT 2024), Association for
Computational Linguistics, 2024.'
date_created: 2024-11-20T10:41:16Z
date_updated: 2025-12-02T19:29:53Z
doi: 10.18653/v1/2024.loresmt-1.18
language:
- iso: eng
publication: Proceedings of the Seventh Workshop on Technologies for Machine Translation
of Low-Resource Languages (LoResMT 2024)
publication_status: published
publisher: Association for Computational Linguistics
status: public
title: Benchmarking Low-Resource Machine Translation Systems
type: conference
user_id: '70066'
year: '2024'
...