Search

Detecting Violations of NST Theorems with LLMs through Retrieval-Augmented Generation

Contribution type: article

Title: Detecting Violations of NST Theorems with LLMs through Retrieval-Augmented Generation

Authors:

Danilo Peeters, NSX bv, Belgium
Geert Haerens, University of Antwerp, Belgium
Herwig Mannaert, University of Antwerp, Belgium

Keywords: Large Language Models, Retrieval-Augmented Generation, Normalized Systems Theory, Software Evolvability

Abstract:

While it is widely accepted that AI tools have the ability to significantly increase the productivity of software development, this contribution focuses on its use to improve software evolvability. More specifically, an artifact is presented that leverages Large Language Models (LLMs) through Retrieval-Augmented Generation (RAG} to automatically detect violations of Normalized Systems Theory (NST) evolvability theorems in source code. This artifact is based on a RAG architecture, where a dedicated knowledge base is created with practical examples of NST violations, and an Abstract Syntax Tree (AST) representation is used to convey code structure into natural language. An experimental setup to validate the artifact is described, allowing participants to engage in three experiments through a web application, and the empirical results are presented. Though the limitations of this validation are acknowledged, the results are deemed positive, and some options for future research are identified.

Publication Date: November 16, 2025

Presented during:

Dates: November 16, 2025 to November 20, 2025

Location: Nice / Saint-Laurent-du-Var, France

Venue:

Novotel Nice Airport Cap 3000

40 Avenue de Verdun
06700 SAINT LAURENT DU VAR
France

Hotel website

Copyright (c) DTR Society, 2025

Contact Us

Proposals

The submission system is currently being prepared. We invite you to subscribe to the newsletter so you will be the first to know when it goes online.