Cognitive relevance transform for population re-targeting

Gregor Koporec (Author), Andrej Košir (Author), Aleš Leonardis (Author), Janez Perš (Author)

Abstract

This work examines the differences between a human and a machine in object recognition tasks. The machine is useful as much as the output classification labels are correct and match the dataset-provided labels. However, very often a discrepancy occurs because the dataset label is different than the one expected by a human. To correct this, the concept of the target user population is introduced. The paper presents a complete methodology for either adapting the output of a pre-trained, state-of-the-art object classification algorithm to the target population or inferring a proper, user-friendly categorization from the target population. The process is called ‘user population re-targeting’. The methodology includes a set of specially designed population tests, which provide crucial data about the categorization that the target population prefers. The transformation between the dataset-bound categorization and the new, population-specific categorization is called the ‘Cognitive Relevance Transform’. The results of the experiments on the well-known datasets have shown that the target population preferred such a transformed categorization by a large margin, that the performance of human observers is probably better than previously thought, and that the outcome of re-targeting may be difficult to predict without actual tests on the target population.

Keywords

kognitivna relevanca;globoko učenje;množično pridobivanje podatkov;populacija ciljnih uporabnikov;kategorizacija;razvrščanje;cognitive relevance;deep learning;crowd-sourcing;target user population;categorization;classification;

Data

Language:	English
Year of publishing:	2020
Typology:	1.01 - Original Scientific Article
Organization:	UL FE - Faculty of Electrical Engineering
UDC:	004.8
COBISS:	38147075
ISSN:	1424-8220
Views:	249
Downloads:	88
Average score:	0 (0 votes)
Metadata:

Other data

Secondary language:	Slovenian
Secondary keywords:	kognitivna relevanca;globoko učenje;množično pridobivanje podatkov;populacija ciljnih uporabnikov;kategorizacija;razvrščanje;
Type (COBISS):	Article
Pages:	str. 1-36
Volume:	ǂiss. ǂ17
Issue:	4668
Chronology:	Sep.-1 2020
DOI:	10.3390/s20174668
ID:	13181170