Using generative AI to improve the performance and interpretability of rule-based diagnosis of Type 2 diabetes mellitus

Leon Kopitar (Avtor), Iztok Fister (Avtor), Gregor Štiglic (Avtor)

Povzetek

Introduction: Type 2 diabetes mellitus is a major global health concern, but interpreting machine learning models for diagnosis remains challenging. This study investigates combining association rule mining with advanced natural language processing to improve both diagnostic accuracy and interpretability. This novel approach has not been explored before in using pretrained transformers for diabetes classification on tabular data. Methods: The study used the Pima Indians Diabetes dataset to investigate Type 2 diabetes mellitus. Python and Jupyter Notebook were employed for analysis, with the NiaARM framework for association rule mining. LightGBM and the dalex package were used for performance comparison and feature importance analysis, respectively. SHAP was used for local interpretability. OpenAI GPT version 3.5 was utilized for outcome prediction and interpretation. The source code is available on GitHub. Results: NiaARM generated 350 rules to predict diabetes. LightGBM performed better than the GPT-based model. A comparison of GPT and NiaARM rules showed disparities, prompting a similarity score analysis. LightGBM’s decision making leaned heavily on glucose, age, and BMI, as highlighted in feature importance rankings. Beeswarm plots demonstrated how feature values correlate with their influence on diagnosis outcomes. Discussion: Combining association rule mining with GPT for Type 2 diabetes mellitus classification yields limited effectiveness. Enhancements like preprocessing and hyperparameter tuning are required. Interpretation challenges and GPT’s dependency on provided rules indicate the necessity for prompt engineering and similarity score methods. Variations in feature importance rankings underscore the complexity of T2DM. Concerns regarding GPT’s reliability emphasize the importance of iterative approaches for improving prediction accuracy.

Ključne besede

GPT;association rule mining;classification;interpretability;diagnostics;

Podatki

Jezik:	Angleški jezik
Leto izida:	2024
Tipologija:	1.01 - Izvirni znanstveni članek
Organizacija:	UM FZV - Fakulteta za zdravstvene vede
Založnik:	MDPI
UDK:	004.8:616.379-008.64
COBISS:	189955587
ISSN:	2078-2489
Št. ogledov:	0
Št. prenosov:	223
Ocena:	0 (0 glasov)
Metapodatki:

Ostali podatki

Sekundarni jezik:	Slovenski jezik
Sekundarne ključne besede:	rudarjenje asociativnih pravil;generativna umetna inteligenca;
Vrsta dela (COBISS):	Znanstveno delo
Strani:	str. 1-17
Letnik:	ǂVol. ǂ15
Zvezek:	ǂno. ǂ3, [article no.] 162
Čas izdaje:	2024
DOI:	10.3390/info15030162
ID:	25411990