prikaz prve stranice dokumenta Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark
No public access
master's thesis
Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark
Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. urn:nbn:hr:168:367169
Lukić, Darija
University of Zagreb
Faculty of Electrical Engineering and Computing

Institutional repository: FER Repository

Cite this document

Lukić, D. (2022). Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark (Master's thesis). Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing. Retrieved from https://urn.nsk.hr/urn:nbn:hr:168:367169

Lukić, Darija. "Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. https://urn.nsk.hr/urn:nbn:hr:168:367169

Lukić, Darija. "Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark." Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, 2022. https://urn.nsk.hr/urn:nbn:hr:168:367169

Lukić, D. (2022). 'Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark', Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, accessed 24 June 2024, https://urn.nsk.hr/urn:nbn:hr:168:367169

Lukić D. Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark [Master's thesis]. Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing; 2022 [cited 2024 June 24] Available at: https://urn.nsk.hr/urn:nbn:hr:168:367169

D. Lukić, "Obrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark", Master's thesis, University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, 2022. Available at: https://urn.nsk.hr/urn:nbn:hr:168:367169

Metadata
TitleObrada velikih podataka korištenjem grafičkih procesora na platformi Apache Spark
Title (english)Big Data Processing using Graphical Processors on Apache Spark
AuthorDarija Lukić
MentorKrešimir Pripužić (mentor)
Committee memberKrešimir Pripužić (predsjednik povjerenstva)
Committee memberMarin Vuković (član povjerenstva)
Committee memberDragan Jevtić (član povjerenstva)
GranterUniversity of Zagreb
Faculty of Electrical Engineering and Computing
Zagreb
Defense date and country2022-07-12, Croatia
Scientific / art field,
discipline and subdiscipline		TECHNICAL SCIENCES
Computing
Abstract
Apache Spark je programski okvir za obradu velikih skupova podataka koji obradu može obavljati na jednom ili više računala. Nudi razvojne API-je za nekoliko programskih jezika od kojih je u studijskom slučaju ovog rada korištena Java. Programske naredbe iz dostupnih razvojnih API-ja izvršavaju se na procesorskoj jedinici - procesoru. Procesor je dizajniran za brzo rješavanje širokog raspona zadataka, ali je ograničen u istodobnosti zadataka koji se mogu izvoditi. Masivnu istodobnost izvršavanja zadataka nudi grafička procesorska jedinica - grafički procesor. Tvrtka NVIDIA razvila je akcelerator RAPIDS namijenjen za grafičke procesore proizvođača NVIDIA. Uključivanjem akceleratora u Sparkove programe koji koriste DataFrame API, određene programske naredbe iz tog API-ja, za koje je podrška razvijena, prebacuju svoje izvođenje s procesora na grafički procesor. Time se paralelizira i ubrzava obrada podataka. U ovom radu je teorijski opisana platforma Apache Spark i akcelerator RAPIDS, a njihova uporaba prikazana je u studijskom slučaju koji obrađuje podatke iz izvora podataka koji je Apache Kafka tema.
Abstract (english)
Apache Spark is a software framework for processing large data sets that can be processed on one or more computers. It provides high-level APIs for several programming languages, of which Java was used in the case study of this paper. Program commands from available development APIs are executed on the central processing unit - processor. Processor is designed to quickly solve a wide range of tasks, but is limited in the concurrency of tasks that can be performed. Massive simultaneity of task execution is offered by a graphics processing unit - a graphics processor. NVIDIA has developed the RAPIDS accelerator for NVIDIA graphics processors. By including accelerator in programs that use the Spark DataFrame API, certain program commands from that API, for which support has been developed, switch their performance from CPU to GPU. This parallelizes and speeds up data processing. This paper theoretically describes the Apache Spark platform and the RAPIDS accelerator, and their use is presented in a case study that processes data from a data source that is an Apache Kafka topic.
Keywords
Keywords (english)
Languagecroatian
URN:NBNurn:nbn:hr:168:367169
Study programmeTitle: Computing
Study programme type: university
Study level: graduate
Academic / professional title: magistar/magistra inženjer/inženjerka računarstva (magistar/magistra inženjer/inženjerka računarstva)
Type of resourceText
File originBorn digital
Access conditionsClosed access
Terms of useLicence In copyright icon
Public note
Created on2023-01-14 09:19:32