---
_id: '32179'
abstract:
- lang: eng
  text: This work addresses the automatic resolution of software requirements. In
    the vision of On-The-Fly Computing, software services should be composed on demand,
    based solely on natural language input from human users. To enable this, we build
    a chatbot solution that works with human-in-the-loop support to receive, analyze,
    correct, and complete their software requirements. The chatbot is equipped with
    a natural language processing pipeline and a large knowledge base, as well as
    sophisticated dialogue management skills to enhance the user experience. Previous
    solutions have focused on analyzing software requirements to point out errors
    such as vagueness, ambiguity, or incompleteness. Our work shows how apps can collaborate
    with users to efficiently produce correct requirements. We developed and compared
    three different chatbot apps that can work with built-in knowledge. We rely on
    ChatterBot, DialoGPT and Rasa for this purpose. While DialoGPT provides its own
    knowledge base, Rasa is the best system to combine the text mining and knowledge
    solutions at our disposal. The evaluation shows that users accept 73% of the suggested
    answers from Rasa, while they accept only 63% from DialoGPT or even 36% from ChatterBot.
author:
- first_name: Joschka
  full_name: Kersting, Joschka
  id: '58701'
  last_name: Kersting
- first_name: Mobeen
  full_name: Ahmed, Mobeen
  last_name: Ahmed
- first_name: Michaela
  full_name: Geierhos, Michaela
  id: '42496'
  last_name: Geierhos
  orcid: 0000-0002-8180-5606
citation:
  ama: 'Kersting J, Ahmed M, Geierhos M. Chatbot-Enhanced Requirements Resolution
    for Automated Service Compositions. In: Stephanidis C, Antona M, Ntoa S, eds.
    <i>HCI International 2022 Posters</i>. Vol 1580. Communications in Computer and
    Information Science (CCIS). Springer International Publishing; 2022:419--426.
    doi:<a href="https://doi.org/10.1007/978-3-031-06417-3_56">10.1007/978-3-031-06417-3_56</a>'
  apa: Kersting, J., Ahmed, M., &#38; Geierhos, M. (2022). Chatbot-Enhanced Requirements
    Resolution for Automated Service Compositions. In C. Stephanidis, M. Antona, &#38;
    S. Ntoa (Eds.), <i>HCI International 2022 Posters</i> (Vol. 1580, pp. 419--426).
    Springer International Publishing. <a href="https://doi.org/10.1007/978-3-031-06417-3_56">https://doi.org/10.1007/978-3-031-06417-3_56</a>
  bibtex: '@inbook{Kersting_Ahmed_Geierhos_2022, place={Cham, Switzerland}, series={Communications
    in Computer and Information Science (CCIS)}, title={Chatbot-Enhanced Requirements
    Resolution for Automated Service Compositions}, volume={1580}, DOI={<a href="https://doi.org/10.1007/978-3-031-06417-3_56">10.1007/978-3-031-06417-3_56</a>},
    booktitle={HCI International 2022 Posters}, publisher={Springer International
    Publishing}, author={Kersting, Joschka and Ahmed, Mobeen and Geierhos, Michaela},
    editor={Stephanidis, Constantine and Antona, Margherita and Ntoa, Stavroula},
    year={2022}, pages={419--426}, collection={Communications in Computer and Information
    Science (CCIS)} }'
  chicago: 'Kersting, Joschka, Mobeen Ahmed, and Michaela Geierhos. “Chatbot-Enhanced
    Requirements Resolution for Automated Service Compositions.” In <i>HCI International
    2022 Posters</i>, edited by Constantine Stephanidis, Margherita Antona, and Stavroula
    Ntoa, 1580:419--426. Communications in Computer and Information Science (CCIS).
    Cham, Switzerland: Springer International Publishing, 2022. <a href="https://doi.org/10.1007/978-3-031-06417-3_56">https://doi.org/10.1007/978-3-031-06417-3_56</a>.'
  ieee: 'J. Kersting, M. Ahmed, and M. Geierhos, “Chatbot-Enhanced Requirements Resolution
    for Automated Service Compositions,” in <i>HCI International 2022 Posters</i>,
    vol. 1580, C. Stephanidis, M. Antona, and S. Ntoa, Eds. Cham, Switzerland: Springer
    International Publishing, 2022, pp. 419--426.'
  mla: Kersting, Joschka, et al. “Chatbot-Enhanced Requirements Resolution for Automated
    Service Compositions.” <i>HCI International 2022 Posters</i>, edited by Constantine
    Stephanidis et al., vol. 1580, Springer International Publishing, 2022, pp. 419--426,
    doi:<a href="https://doi.org/10.1007/978-3-031-06417-3_56">10.1007/978-3-031-06417-3_56</a>.
  short: 'J. Kersting, M. Ahmed, M. Geierhos, in: C. Stephanidis, M. Antona, S. Ntoa
    (Eds.), HCI International 2022 Posters, Springer International Publishing, Cham,
    Switzerland, 2022, pp. 419--426.'
conference:
  end_date: 2022-07-01
  location: Virtual
  name: 24th International Conference on Human-Computer Interaction (HCII 2022)
  start_date: 2022-06-26
date_created: 2022-06-27T09:27:06Z
date_updated: 2022-11-28T13:22:16Z
ddc:
- '004'
department:
- _id: '579'
doi: 10.1007/978-3-031-06417-3_56
editor:
- first_name: Constantine
  full_name: Stephanidis, Constantine
  last_name: Stephanidis
- first_name: Margherita
  full_name: Antona, Margherita
  last_name: Antona
- first_name: Stavroula
  full_name: Ntoa, Stavroula
  last_name: Ntoa
file:
- access_level: closed
  content_type: application/pdf
  creator: jkers
  date_created: 2022-11-28T13:21:32Z
  date_updated: 2022-11-28T13:21:32Z
  file_id: '34150'
  file_name: Kersting et al. (2022), Kersting2022.pdf
  file_size: 1153017
  relation: main_file
  success: 1
file_date_updated: 2022-11-28T13:21:32Z
has_accepted_license: '1'
intvolume: '      1580'
keyword:
- On-The-Fly Computing
- Chatbot
- Knowledge Base
language:
- iso: eng
page: 419--426
place: Cham, Switzerland
project:
- _id: '1'
  name: 'SFB 901: SFB 901'
- _id: '3'
  name: 'SFB 901 - B: SFB 901 - Project Area B'
- _id: '9'
  name: 'SFB 901 - B1: SFB 901 - Subproject B1'
publication: HCI International 2022 Posters
publication_identifier:
  isbn:
  - '9783031064166'
  - '9783031064173'
  issn:
  - 1865-0929
  - 1865-0937
publication_status: published
publisher: Springer International Publishing
related_material:
  link:
  - relation: confirmation
    url: https://link.springer.com/chapter/10.1007/978-3-031-06417-3_56
series_title: Communications in Computer and Information Science (CCIS)
status: public
title: Chatbot-Enhanced Requirements Resolution for Automated Service Compositions
type: book_chapter
user_id: '58701'
volume: 1580
year: '2022'
...
---
_id: '56579'
abstract:
- lang: eng
  text: Question answering engines have become one of the most popular type of applications
    driven by Semantic Web technologies. Consequently, the provision of means to quantify
    the performance of current question answering approaches on current datasets has
    become ever more important. However, a large percentage of the queries found in
    popular question answering benchmarks cannot be executed on current versions of
    their reference dataset. There is a consequently a clear need to curate question
    answering benchmarks periodically. However, the manual alteration of question
    answering benchmarks is often error-prone. We alleviate this problem by presenting
    QUANT, a novel framework for the creation and curation of question answering benchmarks.
    QUANT sup-ports the curation of benchmarks by generating smart edit suggestions
    for question-query pair and for the corresponding metadata. In addition, our framework
    supports the creation of new benchmark entries by pro-viding predefined quality
    checks for queries. We evaluate QUANT on 653questions obtained from QALD-1 to
    QALD-8 with 10 users. Our results show that our framework generates reliable suggestions
    and can reduce the curation effort for QA benchmarks by up to 91%.
author:
- first_name: Ria Hari
  full_name: Gusmita, Ria Hari
  id: '71039'
  last_name: Gusmita
- first_name: Rricha
  full_name: Jalota, Rricha
  last_name: Jalota
- first_name: Daniel
  full_name: Vollmers, Daniel
  last_name: Vollmers
- first_name: Jan
  full_name: Reineke, Jan
  last_name: Reineke
- first_name: Axel-Cyrille
  full_name: Ngonga Ngomo, Axel-Cyrille
  id: '65716'
  last_name: Ngonga Ngomo
- first_name: Ricardo
  full_name: Usbeck, Ricardo
  last_name: Usbeck
citation:
  ama: 'Gusmita RH, Jalota R, Vollmers D, Reineke J, Ngonga Ngomo A-C, Usbeck R. QUANT
    - Question Answering Benchmark Curator. In: Acosta M, Cudr{\’e}-Mauroux P, Maleshkova
    M, Pellegrini T, Sack H, Sure-Vetter Y, eds. <i>Semantic Systems. The Power of
    AI and Knowledge Graphs</i>. Springer International Publishing; 2019:343--358.
    doi:<a href="https://doi.org/10.1007/978-3-030-33220-4_25">10.1007/978-3-030-33220-4_25</a>'
  apa: Gusmita, R. H., Jalota, R., Vollmers, D., Reineke, J., Ngonga Ngomo, A.-C.,
    &#38; Usbeck, R. (2019). QUANT - Question Answering Benchmark Curator. In M. Acosta,
    P. Cudr{\’e}-Mauroux, M. Maleshkova, T. Pellegrini, H. Sack, &#38; Y. Sure-Vetter
    (Eds.), <i>Semantic Systems. The Power of AI and Knowledge Graphs</i> (pp. 343--358).
    Springer International Publishing. <a href="https://doi.org/10.1007/978-3-030-33220-4_25">https://doi.org/10.1007/978-3-030-33220-4_25</a>
  bibtex: '@inbook{Gusmita_Jalota_Vollmers_Reineke_Ngonga Ngomo_Usbeck_2019, place={Cham},
    title={QUANT - Question Answering Benchmark Curator}, DOI={<a href="https://doi.org/10.1007/978-3-030-33220-4_25">10.1007/978-3-030-33220-4_25</a>},
    booktitle={Semantic Systems. The Power of AI and Knowledge Graphs}, publisher={Springer
    International Publishing}, author={Gusmita, Ria Hari and Jalota, Rricha and Vollmers,
    Daniel and Reineke, Jan and Ngonga Ngomo, Axel-Cyrille and Usbeck, Ricardo}, editor={Acosta,
    Maribel and Cudr{\’e}-Mauroux, Philippe and Maleshkova, Maria and Pellegrini,
    Tassilo and Sack, Harald and Sure-Vetter, York}, year={2019}, pages={343--358}
    }'
  chicago: 'Gusmita, Ria Hari, Rricha Jalota, Daniel Vollmers, Jan Reineke, Axel-Cyrille
    Ngonga Ngomo, and Ricardo Usbeck. “QUANT - Question Answering Benchmark Curator.”
    In <i>Semantic Systems. The Power of AI and Knowledge Graphs</i>, edited by Maribel
    Acosta, Philippe Cudr{\’e}-Mauroux, Maria Maleshkova, Tassilo Pellegrini, Harald
    Sack, and York Sure-Vetter, 343--358. Cham: Springer International Publishing,
    2019. <a href="https://doi.org/10.1007/978-3-030-33220-4_25">https://doi.org/10.1007/978-3-030-33220-4_25</a>.'
  ieee: 'R. H. Gusmita, R. Jalota, D. Vollmers, J. Reineke, A.-C. Ngonga Ngomo, and
    R. Usbeck, “QUANT - Question Answering Benchmark Curator,” in <i>Semantic Systems.
    The Power of AI and Knowledge Graphs</i>, M. Acosta, P. Cudr{\’e}-Mauroux, M.
    Maleshkova, T. Pellegrini, H. Sack, and Y. Sure-Vetter, Eds. Cham: Springer International
    Publishing, 2019, pp. 343--358.'
  mla: Gusmita, Ria Hari, et al. “QUANT - Question Answering Benchmark Curator.” <i>Semantic
    Systems. The Power of AI and Knowledge Graphs</i>, edited by Maribel Acosta et
    al., Springer International Publishing, 2019, pp. 343--358, doi:<a href="https://doi.org/10.1007/978-3-030-33220-4_25">10.1007/978-3-030-33220-4_25</a>.
  short: 'R.H. Gusmita, R. Jalota, D. Vollmers, J. Reineke, A.-C. Ngonga Ngomo, R.
    Usbeck, in: M. Acosta, P. Cudr{\’e}-Mauroux, M. Maleshkova, T. Pellegrini, H.
    Sack, Y. Sure-Vetter (Eds.), Semantic Systems. The Power of AI and Knowledge Graphs,
    Springer International Publishing, Cham, 2019, pp. 343--358.'
conference:
  end_date: 2019-09-12
  location: Karlsruhe, Germany
  name: SEMANTiCS 2019
  start_date: 2019-09-09
date_created: 2024-10-10T14:25:00Z
date_updated: 2024-11-19T15:34:24Z
ddc:
- '004'
doi: 10.1007/978-3-030-33220-4_25
editor:
- first_name: Maribel
  full_name: Acosta, Maribel
  last_name: Acosta
- first_name: Philippe
  full_name: Cudr{\'e}-Mauroux, Philippe
  last_name: Cudr{\'e}-Mauroux
- first_name: Maria
  full_name: Maleshkova, Maria
  last_name: Maleshkova
- first_name: Tassilo
  full_name: Pellegrini, Tassilo
  last_name: Pellegrini
- first_name: Harald
  full_name: Sack, Harald
  last_name: Sack
- first_name: York
  full_name: Sure-Vetter, York
  last_name: Sure-Vetter
file:
- access_level: closed
  content_type: application/pdf
  creator: gusmita
  date_created: 2024-11-19T15:28:45Z
  date_updated: 2024-11-19T15:28:45Z
  file_id: '57244'
  file_name: Gusmita_et_al-2019-Semantic_Systems._The_Power_of_AI_and_Knowledge_Graphs,_15th_International....pdf
  file_size: 1179910
  relation: main_file
  success: 1
file_date_updated: 2024-11-19T15:28:45Z
has_accepted_license: '1'
keyword:
- Benchmark
- Question answering
- Knowledge base
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://rdcu.be/d0KJc
oa: '1'
page: 343--358
place: Cham
publication: Semantic Systems. The Power of AI and Knowledge Graphs
publication_identifier:
  eisbn:
  - 978-3-030-33220-4
  isbn:
  - 978-3-030-33219-8
  issn:
  - 0302-9743
  - 1611-3349
publication_status: published
publisher: Springer International Publishing
status: public
title: QUANT - Question Answering Benchmark Curator
type: book_chapter
user_id: '71039'
year: '2019'
...