article published Sascha Benjamin Kaltenpoth author 50640 Oliver Müller author 72849 <jats:p>As a possible solution to the demographic change and the resulting knowledge loss due to retirements in the Energy sector, this study aimed to develop a generic pipeline to implement and evaluate proof-of-concepts (PoCs) for LLM-based assistance systems in new domains. Our pipeline contains an LLM-based data generation strategy based on documents, a retrieval-augmented generation (RAG) architecture utilizing prompting techniques on existing German LLMs, and an LLM-based automatic evaluation strategy. We leverage our pipeline to evaluate five LLMs using data from a German DSO. We found that the Llama3 and the Mistral model are appropriately aligned for the task. We plan to pilot the RAG architecture in the DSO's infrastructure for future research and continuously research improvements using the generated human demonstrations.</jats:p> Association for Computing Machinery (ACM)2025 eng 2770-533110.1145/3717413.3717415 4416-22 @article{Kaltenpoth_Müller_2025, title={Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System}, volume={4}, DOI={<a href="https://doi.org/10.1145/3717413.3717415">10.1145/3717413.3717415</a>}, number={4}, journal={ACM SIGEnergy Energy Informatics Review}, publisher={Association for Computing Machinery (ACM)}, author={Kaltenpoth, Sascha Benjamin and Müller, Oliver}, year={2025}, pages={16–22} } Kaltenpoth SB, Müller O. Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System. <i>ACM SIGEnergy Energy Informatics Review</i>. 2025;4(4):16-22. doi:<a href="https://doi.org/10.1145/3717413.3717415">10.1145/3717413.3717415</a> Kaltenpoth, Sascha Benjamin, and Oliver Müller. “Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System.” <i>ACM SIGEnergy Energy Informatics Review</i>, vol. 4, no. 4, Association for Computing Machinery (ACM), 2025, pp. 16–22, doi:<a href="https://doi.org/10.1145/3717413.3717415">10.1145/3717413.3717415</a>. Kaltenpoth, Sascha Benjamin, and Oliver Müller. “Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System.” <i>ACM SIGEnergy Energy Informatics Review</i> 4, no. 4 (2025): 16–22. <a href="https://doi.org/10.1145/3717413.3717415">https://doi.org/10.1145/3717413.3717415</a>. S.B. Kaltenpoth, O. Müller, ACM SIGEnergy Energy Informatics Review 4 (2025) 16–22. S. B. Kaltenpoth and O. Müller, “Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System,” <i>ACM SIGEnergy Energy Informatics Review</i>, vol. 4, no. 4, pp. 16–22, 2025, doi: <a href="https://doi.org/10.1145/3717413.3717415">10.1145/3717413.3717415</a>. Kaltenpoth, S. B., &#38; Müller, O. (2025). Don’t Touch the Power Line - A Proof-of-Concept for Aligned LLM-Based Assistance Systems to Support the Maintenance in the Electricity Distribution System. <i>ACM SIGEnergy Energy Informatics Review</i>, <i>4</i>(4), 16–22. <a href="https://doi.org/10.1145/3717413.3717415">https://doi.org/10.1145/3717413.3717415</a> 611602025-09-09T12:30:30Z2025-09-09T12:31:07Z