IPAD

Iterative Pruning with Activation Deviation for sclera biometrics

Matej Vitek (Avtor), Matic Bizjak (Avtor), Peter Peer (Avtor), Vitomir Štruc (Avtor)

Povzetek

The sclera has recently been gaining attention as a biometric modality due to its various desirable characteristics. A key step in any type of ocular biometric recognition, including sclera recognition, is the segmentation of the relevant part(s) of the eye. However, the high computational complexity of the (deep) segmentation models used in this task can limit their applicability on resource-constrained devices such as smartphones or head-mounted displays. As these devices are a common desired target for such biometric systems, lightweight solutions for ocular segmentation are critically needed. To address this issue, this paper introduces IPAD (Iterative Pruning with Activation Deviation), a novel method for developing lightweight convolutional networks, that is based on model pruning. IPAD uses a novel filter-activation-based criterion (ADC) to determine low-importance filters and employs an iterative model pruning procedure to derive the final lightweight model. To evaluate the proposed pruning procedure, we conduct extensive experiments with two diverse segmentation models, over four publicly available datasets (SBVPI, SLD, SMD and MOBIUS), in four distinct problem configurations and in comparison to state-of-the-art methods from the literature. The results of the experiments show that the proposed filter-importance criterion outperforms the standard L$^1$ and L$^2$ approaches from the literature. Furthermore, the results also suggest that: (i) the pruned models are able to retain (or even improve on) the performance of the unpruned originals, as long as they are not over-pruned, with RITnet and U-Net at 50% of their original FLOPs reaching up to 4% and 7% higher IoU values than their unpruned versions, respectively, (ii) smaller models require more careful pruning, as the pruning process can hurt the model’s generalization capabilities, and (iii) the novel criterion most convincingly outperforms the classic approaches when sufficient training data is available, implying that the abundance of data leads to more robust activation-based importance computation.

Ključne besede

biometrija;segmentacija beločnice;očesna biometrija;segmentacija očesa;rezanje modelov;lahko globoko učenje;biometrics;sclera segmentation;ocular biometrics;ocular segmentation;model pruning;lightweight deep learning;

Podatki

Jezik:	Angleški jezik
Leto izida:	2023
Tipologija:	1.01 - Izvirni znanstveni članek
Organizacija:	UL FE - Fakulteta za elektrotehniko
UDK:	004.93:57.087.1
COBISS:	157745667
ISSN:	1319-1578
Št. ogledov:	47
Št. prenosov:	6
Ocena:	0 (0 glasov)
Metapodatki:

Ostali podatki

Sekundarni jezik:	Slovenski jezik
Sekundarne ključne besede:	biometrija;segmentacija beločnice;očesna biometrija;segmentacija očesa;rezanje modelov;lahko globoko učenje;
Vrsta dela (COBISS):	Članek v reviji
Strani:	str. 1-21
Letnik:	ǂVol. ǂ35
Zvezek:	ǂiss. ǂ8, [article no.] 101630
Čas izdaje:	Sep. 2023
DOI:	10.1016/j.jksuci.2023.101630
ID:	21708530