diplomsko delo
Anže Habjan (Author), Slavko Žitnik (Mentor)

Abstract

V času, ko količina generiranih podatkov na spletu narašča tako hitro kot še nikoli, je toliko bolj pomembno, da je obdelava le teh kar se da hitra. Opišemo implementacijo celostnega sistema, ki bo specializiran za obdelavo pretočnih podatkov v skoraj realnem času, in bo vključeval po eno orodje za vsak del: pridobivanje, obdelava, shranjevanje in vizualizacija. Posamezna orodja so utemeljeno izbrana na podlagi našega realnega primera uporabe sistema, ki je obdelava čivkov (tweet), ki nastanejo na omrežju Twitter v času nogometne tekme. Na primeru uporabe tudi prikažemo analize in vizualizacije, ki jih omogoča implementiran sistem. Zaključimo s prikazom nekaj metrik našega sistema v času obdelave.

Keywords

veliki podatki;obdelava;skoraj realni čas;Twitter;nogomet;računalništvo in informatika;univerzitetni študij;diplomske naloge;

Data

Language: Slovenian
Year of publishing:
Typology: 2.11 - Undergraduate Thesis
Organization: UL FRI - Faculty of Computer and Information Science
Publisher: [A. Habjan]
UDC: 004.6(043.2)
COBISS: 78022915 Link will open in a new window
Views: 209
Downloads: 47
Average score: 0 (0 votes)
Metadata: JSON JSON-RDF JSON-LD TURTLE N-TRIPLES XML RDFA MICRODATA DC-XML DC-RDF RDF

Other data

Secondary language: English
Secondary title: Near real-time processing of large amounts of data
Secondary abstract: Today, the amount of data generated on the web is growing as fast as ever, therefore it's utmost important that the processing is as fast as possible. We describe the implementation of an end-to-end system, which will specialize in near real-time processing big data, and will include one framework for each part: retrieval, processing, storage and visualization. The individual frameworks are selected on the basis of our use case of the system, which is the processing of tweets generated on social network Twitter during a football match. For our use case, we also show the analyses and visualizations possible by our system. We end with displaying some of the system metrics gathered during our system's execution.
Secondary keywords: big data;processing;near real-time;Twitter;football;computer science;computer and information science;diploma;Obdelava podatkov v realnem času;Računalništvo;Univerzitetna in visokošolska dela;
Type (COBISS): Bachelor thesis/paper
Study programme: 1000468
Thesis comment: Univ. v Ljubljani, Fak. za računalništvo in informatiko
Pages: 75 str.
ID: 13418749