Title Model vrednovanja ishoda učenja u STEM području zasnovan na principima obrazovnih sustava preporučivanja
Title (croatian) Model of learning outcomes evaluation in STEM based on the principles of educational recommender systems
Author Gordan Đurović
Mentor Nataša Hoić-Božić (mentor)
Mentor Martina Holenko Dlab (komentor)
Committee member Ana Meštrović (predsjednik povjerenstva)
Committee member Božidar Kovačić (član povjerenstva)
Committee member Vedran Mornar (član povjerenstva)
Granter University of Rijeka (Faculty of Informatics and Digital Technologies) Rijeka
Defense date and country 2024-04-12, Croatia
Scientific / art field, discipline and subdiscipline SOCIAL SCIENCES Information and Communication Sciences
Universal decimal classification (UDC ) 37 - Education
Abstract U ovom se doktorskom radu opisuju istraživanja čiji je glavni cilj bio razviti model sustava za vrednovanje ishoda učenja u STEM području temeljenog na principima obrazovnih sustava preporučivanja. Razvijeni model omogućio je povezivanje podataka koji se u sustavu prikupljaju tijekom vrednovanja znanja studenata s podacima obrazovnog sustava preporučivanja, a sve s ciljem poticanja motiviranosti studenata za učenje te generiranja više vrsta preporuka kako bi se studentima omogućilo usvajanje ishoda učenja.
Ishodi učenja su pisani iskazi iskaza kojima se definira što studenti trebaju znati, razumjeti i/ili biti u stanju pokazati nakon što završe određeni proces učenja. Poznavanje i aktivno korištenje ishoda učenja studentima omogućava optimalnu organizaciju vremena i planiranih aktivnosti učenja, te stvara temelj za ostvarivanje boljih rezultata učenja. Tijekom učenja kontinuiranu podršku studentima mogu pružiti obrazovni sustavi preporučivanja. Njihova osnovna namjena je generiranje odgovarajućih preporuka individualnim studentima koje se izrađuju temeljem algoritama osmišljenih za njihov rad. S druge strane, sustavi za online vrednovanje predstavljaju alat putem kojega se može provoditi formativno i sumativno vrednovanje uz davanje brzih povratnih informacija o uspješnosti rada studenata. Model razvijen u provedenom istraživanju objedinio je funkcionalnosti ova dva sustava pri čemu su ishodi učenja iskorišteni kao povezujući element.
U obrazovanju u STEM području, jedna od uobičajenih metoda vrednovanja znanja studenata je putem rješavanja matematičkih zadataka. Većina ovih sustava koji se danas koriste svoju funkcionalnost zasniva na provjeri točnosti završnog rezultata zadataka čime se zanemaruju podaci o točnosti međurezultata u tim zadacima. Praćenje točnosti rada studenata na razini međurezultata može omogućiti kontinuirano praćenje usvojenost koncepata odnosno usvojenost ishoda učenja uz generiranje pravovremenih preporuka studentima s ciljem pozitivnog utjecaja na njihovu motiviranost za daljnji rad. Model sustava koji je razvijen u okviru ovog istraživanja uključuje praćenje uspješnosti rada studenata na razini međurezultata u zadacima, što predstavlja jednu od njegovih posebnosti.
Razvijeni model sustava omogućio je i uspješno uvođenje kontinuiranog online vrednovanja znanja u izvedbu odgojno-obrazovnog procesa. Praćenje uspješnosti studenata tijekom kontinuiranog vrednovanja znanja na razini međurezultata u rješavanim zadacima omogućilo je kreiranje proširenog skupa podataka za rad sustava. Ovaj prošireni skup podataka korišten je kao osnova za praćenje trenutne razine usvojenosti koncepata i ishoda učenja svakog studenta te generiranje tri tipa individualiziranih preporuka: preporuka suradnika, preporuka sljedećeg koraka u učenju odnosno preporuka za povećanje motivacije. Navedene su preporukepozitivno utjecale na motiviranost studenata što je dovelo i do boljih rezultata učenja tijekom semestra, a omogućilo je studentima i usvajanje ishoda učenja.
Osmišljeni je model implementiran u obliku mrežne aplikacije čija je funkcionalnost ispitana u radu sa studentima upisanim na sveučilišne odnosno stručne prijediplomske studije na Tehničkom fakultetu Sveučilišta u Rijeci. Za rad aplikacije osmišljeni su algoritmi zasnovani na primjeni neizrazite logike koji su koristili prošireni skup podataka prikupljenih provođenjem kontinuiranog online vrednovanja. Istraživanje je provedeno korištenjem metodologije istraživanja zasnovanog na dizajnu te je u eksperimentalnoj fazi istraživanja provedeno šest ciklusa u pet uzastopnih akademskih godina. Rezultati dobiveni provedenim istraživanjem potvrdili su pozitivan utjecaj osmišljenog modela sustava na motiviranost studenata uključenih u istraživanje, uspješnost sustava u omogućavanju usvajanja ishoda učenja temeljem generiranih preporuka individualnim studentima kao i ostvarivanje boljih rezultata učenja tijekom semestra.
Abstract (english) This doctoral thesis describes a research whose main objective was to develop a model for the evaluation of learning outcomes in STEM education based on the principles of educational recommendation systems. The developed model made it possible to connect the data collected in the system during the assessment of students' knowledge with the data of the educational recommendation system, all with the aim of promoting students' motivation to learn and generating different types of recommendations that enable students to achieve learning outcomes.
Learning outcomes are written statements that define what students should know, understand and/or be able to demonstrate upon completion of a particular learning process. Knowing and actively using learning outcomes enables students to organize time and planned learning activities optimally and creates a basis for better learning results. During learning, students can be continuously supported by educational recommendation systems. Their main purpose is to generate appropriate recommendations for individual students based on algorithms developed for their work. On the other hand, online evaluation systems represent a tool that can be used for formative and summative evaluation while providing quick feedback on the success of students' work. The model developed in the conducted research combines the functionalities of these two systems, with learning outcomes serving as the connecting element.
In STEM education, solving math tasks is one of the most common ways to assess students' knowledge. Most of the systems used today are based on checking the accuracy of the final outcome, while the data on the accuracy of intermediate results in these tasks is ignored. Monitoring the accuracy of intermediate results can enable continuous monitoring of the achievement of concepts, i.e. the achievement of learning outcomes, while providing timely recommendations to students to positively influence their motivation for further work. The system model developed in this research includes the monitoring of students' work success at the level of intermediate results in the tasks, which is one of its distinctive features.
The developed model enabled the successful implementation of a continuous online evaluation in the educational process. The observation of student performance in continuous knowledge assessment at the level of intermediate results in solved tasks enabled the creation of an extended data set for system operation. This extended data set served as a basis for monitoring the current level at which students have mastered concepts, i.e. learning outcomes, and for creating three types of individualized recommendations: recommendations of associates, recommendations for the next learning step, and recommendations to increase motivation. The above recommendations had a positive impact on student motivation which led to better results of learning activities during the semester and enabled students to achieve the learning outcomes.
The designed model was implemented in the form of a network application, the functionality of which was tested in work with students enrolled in university and vocational undergraduate study programs at the Faculty of Engineering, University of Rijeka. Algorithms based on the application of fuzzy logic were developed for the operation of the network application, using an extended data set collected by conducting a continuous online evaluation of students knowledge. The research was conducted using the design-based research methodology, and in the experimental phase of the research, six cycles were conducted in five consecutive years. The results of the conducted research confirmed the positive impact of the developed model on the motivation of the students involved in the research, the success of the model in helping students achieve learning outcomes based on the recommendations generated for each student, and the achievement of better results of learning activities during the semester.
Keywords
ishodi učenja
obrazovni sustav preporučivanja
sustav za online vrednovanje
STEM
neizrazita logika
Keywords (english)
learning outcomes
educational recommendation system
system for online evaluation
STEM
fuzzy logic
Language croatian
URN:NBN urn:nbn:hr:195:467974
Promotion 2024
Study programme Title: Informatics Study programme type: university Study level: postgraduate Academic / professional title: doktor znanosti iz znanstvenog područja Društvene znanosti, polja Informacijske i komunikacijske znanosti. (doktor znanosti iz znanstvenog područja Društvene znanosti, polja Informacijske i komunikacijske znanosti.)
Type of resource Text
File origin Born digital
Access conditions Open access
Terms of use
Created on 2024-04-25 07:07:01