Učinkovitost avtomatiziranega oblikovanja testnih primerov s pomočjo velikih jezikovnih modelov

magistrsko delo

Jovana Murdjeva (Author), Tina Schweighofer (Mentor), Sašo Karakatič (Co-mentor)

Abstract

V magistrskem delu je bila raziskana uporabo ChatGPT-ja kot veliki jezikovni model za avtomatizirano oblikovanje testnih primerov v primerjavi s tradicionalnimi metodami, ki jih uporabljajo strokovnjaki za testiranje programske opreme. Delo se je osredotočilo na vpliv natančno opredeljenih pozivov (inženiring pozivov) na kakovost, pokritost kode in učinkovitost pri odkrivanju napak. Rezultati raziskave kažejo, da ChatGPT z ustrezno oblikovanimi vnosnimi zahtevami dosega primerljivo ali celo boljšo uspešnost kot ročno oblikovani testi, kar pomeni velik potencial za optimizacijo procesov testiranja programske opreme.

Keywords

avtomatizirano testiranje;veliki jezikovni modeli;inženiring pozivov;ChatGPT;kakovost testnih primerov;magistrske naloge;

Data

Language:	Slovenian
Year of publishing:	2024
Typology:	2.09 - Master's Thesis
Organization:	UM FERI - Faculty of Electrical Engineering and Computer Science
Publisher:	[J. Murdjeva]
UDC:	004.434:004.8(043.2)
COBISS:	224467715
Views:	0
Downloads:	23
Average score:	0 (0 votes)
Metadata:

Other data

Secondary language:	English
Secondary title:	The effectiveness of automated test case design using large language models
Secondary abstract:	In the master's thesis, we explored the use of ChatGPT, as a large language model, for automated test case design compared to traditional methods used by software testing experts. We focused on the impact of precisely defined prompts (prompt engineering) on the quality, code coverage, and effectiveness in detecting errors. The research results indicate that ChatGPT, with properly crafted input requirements, achieves comparable or even better performance than manually designed tests, highlighting significant potential for optimizing software testing processes.
Secondary keywords:	automated testing;large language models;prompt engineering;ChatGPT;test case quality;master's theses;
Type (COBISS):	Master's thesis/paper
Thesis comment:	Univ. v Mariboru, Fak. za elektrotehniko, računalništvo in informatiko, Informatika in podatkovne tehnologije
Pages:	1 spletni vir (1 datoteka PDF (VII, 98 f.))
ID:	25092816