diplomsko delo
Leon Modic (Author), Luka Čehovin (Mentor)

Abstract

Eden izmed glavnih načinov uporabe obogatene resničnosti je dodajanje objektov in označb v 3D prostor zajet s kamero mobilne naprave. Novi objekti v sceni morajo biti osvetljeni na način, ki odraža resnično osvetlitev, saj se na ta način zdijo bolj resnični in se zlijejo z okolico. V tem diplomskem delu smo razvili metodo za hitro in robustno določanje osvetlitve scene z uporabo konvolucijskih nevronskih mrež, ki bo lahko uporabljena v kontekstu obogatene resničnosti. Izdelali smo tudi zbirko sintetičnih podatkov, ki je bila uporabljena za učenje razvite mreže. Naučili smo več modelov z različnimi arhitekturami hrbtenice in primerjali njihovo natančnost ter hitrost na zbirki zajetih fotografij iz resničnega sveta. Rezultati eksperimentov kažejo uspešnost pri določanju smeri glavnega svetlobnega vira s pomočjo konvolucijskih nevronskih mrež tudi na podatkih, ki jih mreža med učenjem ni videla. Na koncu smo rezultate tudi vizualizirali na nekaterih izmed zajetih fotografij.

Keywords

obogatena resničnost;osvetlitev;konvolucijske nevronske mreže;univerzitetni študij;diplomske naloge;

Data

Language: Slovenian
Year of publishing:
Typology: 2.11 - Undergraduate Thesis
Organization: UL FRI - Faculty of Computer and Information Science
Publisher: [L. Modic]
UDC: 004.93:004.946(043.2)
COBISS: 101461251 Link will open in a new window
Views: 109
Downloads: 24
Average score: 0 (0 votes)
Metadata: JSON JSON-RDF JSON-LD TURTLE N-TRIPLES XML RDFA MICRODATA DC-XML DC-RDF RDF

Other data

Secondary language: English
Secondary title: Determining scene illumination in augmented reality
Secondary abstract: One of the main use cases of augmented reality is to add objects and markings to a 3D space captured by a mobile device camera. New objects in a scene need proper lighting that reflects real lighting, as this way they appear more realistic and blend in better with the surroundings. In this dissertation, we developed a method for fast and robust detection of scene lighting using convolutional neural networks, which could be used in the context of augmented reality. We also created a dataset consisting of synthetic images used for training the convolutional neural network. We trained multiple models with different backbone architectures, and we compared their accuracy and speed on a dataset consisting of captured photos from the real world. The results of experiments demonstrate that convolutional neural networks can successfully determine the direction of the main light source on data not seen by the network during training. In the end, we visualized the results on some of the captured real world photos.
Secondary keywords: computer vision;augmented reality;lighting;convolutional neural networks;computer science;diploma;Računalniški vid;Navidezna resničnost;Računalništvo;Univerzitetna in visokošolska dela;
Type (COBISS): Bachelor thesis/paper
Study programme: 1000468
Thesis comment: Univ. v Ljubljani, Fak. za računalništvo in informatiko
Pages: 53 str.
ID: 14768474