Computer science education in ChatGPT Era: experiences from an experiment in a programming course for novice programmers

Tomaž Kosar (Avtor), Dragana Ostojić (Avtor), Yu David Liu (Avtor), Marjan Mernik (Avtor)

Povzetek

The use of large language models with chatbots like ChatGPT has become increasingly popular among students, especially in Computer Science education. However, significant debates exist in the education community on the role of ChatGPT in learning. Therefore, it is critical to understand the potential impact of ChatGPT on the learning, engagement, and overall success of students in classrooms. In this empirical study, we report on a controlled experiment with 182 participants in a first-year undergraduate course on object-oriented programming. Our differential study divided students into two groups, one using ChatGPT and the other not using it for practical programming assignments. The study results showed that the students’ performance is not influenced by ChatGPT usage (no statistical significance between groups with a p-value of 0.730), nor are the grading results of practical assignments (p-value 0.760) and midterm exams (p-value 0.856). Our findings from the controlled experiment suggest that it is safe for novice programmers to use ChatGPT if specific measures and adjustments are adopted in the education process.

Ključne besede

jezikovni modeli;umetna inteligenca;objektno orientirano programiranje;large language models;ChatGPT;artificial intelligence;controlled experiment;object-oriented programming;software engineering education;

Podatki

Jezik:	Angleški jezik
Leto izida:	2024
Tipologija:	1.01 - Izvirni znanstveni članek
Organizacija:	UM FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
Založnik:	MDPI
UDK:	621.3
COBISS:	187200259
ISSN:	2227-7390
Št. ogledov:	59
Št. prenosov:	12
Ocena:	0 (0 glasov)
Metapodatki:

Ostali podatki

Sekundarni jezik:	Slovenski jezik
Sekundarne ključne besede:	jezikovni modeli;umetna inteligenca;objektno orientirano programiranje;
Vrsta dela (COBISS):	Članek v reviji
Strani:	22 str.
Letnik:	ǂVol. ǂ12
Zvezek:	ǂno. ǂ5, [article no.] 629
Čas izdaje:	2024
DOI:	10.3390/math12050629
ID:	24707456