prikaz prve stranice dokumenta Jezični model temeljen na neuronskoj mreži
No public access
master's thesis
Jezični model temeljen na neuronskoj mreži
Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing, 2015. urn:nbn:hr:168:939585
Stamenković, Florijan
University of Zagreb
Faculty of Electrical Engineering and Computing

Institutional repository: FER Repository

Cite this document

Stamenković, F. (2015). Jezični model temeljen na neuronskoj mreži (Master's thesis). Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing. Retrieved from https://urn.nsk.hr/urn:nbn:hr:168:939585

Stamenković, Florijan. "Jezični model temeljen na neuronskoj mreži." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2015. https://urn.nsk.hr/urn:nbn:hr:168:939585

Stamenković, Florijan. "Jezični model temeljen na neuronskoj mreži." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2015. https://urn.nsk.hr/urn:nbn:hr:168:939585

Stamenković, F. (2015). 'Jezični model temeljen na neuronskoj mreži', Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, accessed 20 May 2024, https://urn.nsk.hr/urn:nbn:hr:168:939585

Stamenković F. Jezični model temeljen na neuronskoj mreži [Master's thesis]. Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing; 2015 [cited 2024 May 20] Available at: https://urn.nsk.hr/urn:nbn:hr:168:939585

F. Stamenković, "Jezični model temeljen na neuronskoj mreži", Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, 2015. Available at: https://urn.nsk.hr/urn:nbn:hr:168:939585

Metadata
TitleJezični model temeljen na neuronskoj mreži
Title (english)Neural language model
AuthorFlorijan Stamenković
MentorMarin Golub (mentor)
Committee memberMarin Golub (predsjednik povjerenstva)
Committee memberŽeljka Mihajlović (član povjerenstva)
Committee memberMarko Čupić (član povjerenstva)
GranterUniversity of Zagreb
Faculty of Electrical Engineering and Computing
Zagreb
Defense date and country2015-07-14, Croatia
Scientific / art field,
discipline and subdiscipline		TECHNICAL SCIENCES
Computing
Abstract
U ovom diplomskom radu razmatraju se četiri različita pristupa izgradnji jezičnih modela. U uvodu se daje kratak osvrt na moguće primjene jezičnih modela općenito. Potom se definiraju modeli bazirani na zaglađenom prebrojavanju n-grama (korištenjem aditivnog zaglađivanja i zaglađivanja Kneser-Ney metodom), umjetnoj neuronskoj mreži bez skrivenih slojeva, log-bilinearnom modelu i ograničenom Boltzmannovom stroju. Razmatraju se teoretske i implementacijske posebnosti opisanih modela. Potom se modeli vrednuju standardnim mjerama i po uspješnosti na zadatku Microsoft Research Sentence Completion. Dobiveni rezultati se uspoređuju s rezultatima iz sličnih radova. Daje se kratko razmatranje vremenske i memorijske složenosti izrade i korištenja modela, kao i usporedba vremena treniranja korištenjem središnjih i grafičkih procesora.
Abstract (english)
This master thesis cosiders four approaches to language model implementation. An introduction into language models and their application is presented. Following are the definitions of models based on n-gram counts with additive and Kneser-Ney smoothing, neural networks with no hidden layers, log-bilinear models and Restricted Boltzmann Machines. For each a theoretical description is given, as well implementation details. Models are evaluated using standard metrics and on Microsoft Research Sentence Completion Challenge. Results are compared to those from other papers. A brief comparison of model complexity (in time and memory space) is offered, as well as a comparison of iterative model training speed using central versus graphical processors.
Keywords
Keywords (english)
Languagecroatian
URN:NBNurn:nbn:hr:168:939585
Study programmeTitle: Computing
Study programme type: university
Study level: graduate
Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
Type of resourceText
File originBorn digital
Access conditionsClosed access
Terms of useLicence In copyright icon
Public note
Created on2018-02-06 12:05:09