Face deidentification with controllable privacy protection

Blaž Meden (Author), Manfred Gonzalez-Hernandez (Author), Peter Peer (Author), Vitomir Štruc (Author)

Abstract

Privacy protection has become a crucial concern in today’s digital age. Particularly sensitive here are facial images, which typically not only reveal a person’s identity, but also other sensitive personal information. To address this problem, various face deidentification techniques have been presented in the literature. These techniques try to remove or obscure personal information from facial images while still preserving their usefulness for further analysis. While a considerable amount of work has been proposed on face deidentification, most state-of-the-art solutions still suffer from various drawbacks, and (a) deidentify only a narrow facial area, leaving potentially important contextual information unprotected, (b) modify facial images to such degrees, that image naturalness and facial diversity is suffering in the deidentify images, (c) offer no flexibility in the level of privacy protection ensured, leading to suboptimal deployment in various applications, and (d) often offer an unsatisfactory trade-off between the ability to obscure identity information, quality and naturalness of the deidentified images, and sufficient utility preservation. In this paper, we address these shortcomings with a novel controllable face deidentification technique that balances image quality, identity protection, and data utility for further analysis. The proposed approach utilizes a powerful generative model (StyleGAN2), multiple auxiliary classification models, and carefully designed constraints to guide the deidentification process. The approach is validated across four diverse datasets (CelebA-HQ, RaFD, XM2VTS, AffectNet) and in comparison to 7 state-of-the-art competitors. The results of the experiments demonstrate that the proposed solution leads to: (a) a considerable level of identity protection, (b) valuable preservation of data utility, (c) sufficient diversity among the deidentified faces, and (d) encouraging overall performance.

Keywords

deidentifkacija obraza;varovanje zasebnosti;podatkovna uporabnost;tehnologije za izboljšanje zasebnosti;biometrija obrazov;globoko učenje;face deidentifcation;privacy protection;data utility;privacy-enhancing technologies;face biometrics;deep learning;

Data

Language:	English
Year of publishing:	2023
Typology:	1.01 - Original Scientific Article
Organization:	UL FE - Faculty of Electrical Engineering
UDC:	004.93:57.087.1
COBISS:	150487811
ISSN:	0262-8856
Views:	143
Downloads:	22
Average score:	0 (0 votes)
Metadata:

Other data

Secondary language:	Slovenian
Secondary keywords:	deidentifikacija obraza;varovanje zasebnosti;podatkovna uporabnost;tehnologije za izboljšanje zasebnosti;biometrija obrazov;globoko učenje;
Type (COBISS):	Article
Pages:	str. 1-19
Volume:	ǂVol. ǂ134
Issue:	[article no.] 104678
Chronology:	Jun. 2023
DOI:	10.1016/j.imavis.2023.104678
ID:	18957942