prikaz prve stranice dokumenta Sustav za generiranje opisa slika
No public access
master's thesis
Sustav za generiranje opisa slika
Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. urn:nbn:hr:168:633150
Imbrišak, Mateo
University of Zagreb
Faculty of Electrical Engineering and Computing

Institutional repository: FER Repository

Cite this document

Imbrišak, M. (2022). Sustav za generiranje opisa slika (Master's thesis). Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing. Retrieved from https://urn.nsk.hr/urn:nbn:hr:168:633150

Imbrišak, Mateo. "Sustav za generiranje opisa slika." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. https://urn.nsk.hr/urn:nbn:hr:168:633150

Imbrišak, Mateo. "Sustav za generiranje opisa slika." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. https://urn.nsk.hr/urn:nbn:hr:168:633150

Imbrišak, M. (2022). 'Sustav za generiranje opisa slika', Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, accessed 20 May 2024, https://urn.nsk.hr/urn:nbn:hr:168:633150

Imbrišak M. Sustav za generiranje opisa slika [Master's thesis]. Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing; 2022 [cited 2024 May 20] Available at: https://urn.nsk.hr/urn:nbn:hr:168:633150

M. Imbrišak, "Sustav za generiranje opisa slika", Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, 2022. Available at: https://urn.nsk.hr/urn:nbn:hr:168:633150

Metadata
TitleSustav za generiranje opisa slika
Title (english)System for Image Captioning
AuthorMateo Imbrišak
MentorTomislav Hrkać (mentor)
Committee memberTomislav Hrkać (predsjednik povjerenstva)
Committee memberDejan Škvorc (član povjerenstva)
Committee memberZoran Kalafatić (član povjerenstva)
GranterUniversity of Zagreb
Faculty of Electrical Engineering and Computing
Zagreb
Defense date and country2022-07-04, Croatia
Scientific / art field,
discipline and subdiscipline		TECHNICAL SCIENCES
Computing
Abstract
Automatsko generiranje opisa slika problem je koji spaja računalni vid i obradu prirodnog jezika. Automatsko generiranje opisa primjenjivo je na društvenim mrežama kao i u sustavim za sintezu govora za pomoć osobama slabijeg vida. U ovom radu ostvarena su dva modela za generiranje opisa slika. Oba modela oslanjaju se na postojeću implementaciju mreže ResNet za obradu slika, a razlikuju se u implementaciji dekodera. Ostvareni dekoderi koriste jednu ili dvije LSTM ćelije, a u slučaju korištenja dvije ili više ćelija one su povezane u rezidualne blokove. Istaknuta je važnost odabira algoritma za odabir generirane riječi u svakom koraku te da nije uvijek najbolje birati najvjerojatniju riječ u svakom koraku. Priloženi su rezultati, mjerenja te primjeri slika iz skupa za treniranje s generiranim opisima.
Abstract (english)
Automatic image captioning is a problem that combines computer vision and natural language processing. It is applicable on social media platforms as well as in text-to-speech systems used to help people with impaired vision. Two image captioning systems are developed for this thesis. Both models rely on existing ResNet implementation to handle image processing, but the differ when it comes to their decoder implementations. Decoder use one or two LSTM cells and when two or more LSTM cells are used, they are stacked to form residual blocks. Importance of choosing the right search algorithm is emphasized as well as the fact that choosing the most likely word in each time step is not always the best option. Results, tests and examples of images from test set, along with their generated captions are included at the end.
Keywords
Keywords (english)
Languagecroatian
URN:NBNurn:nbn:hr:168:633150
Study programmeTitle: Computing
Study programme type: university
Study level: graduate
Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
Type of resourceText
File originBorn digital
Access conditionsClosed access
Terms of useLicence In copyright icon
Public note
Created on2023-01-14 08:56:03