MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers - Centre of Innovation in Telecommunications and Integration of services Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers

Résumé

Machine Learning (ML) has emerged as a core technology to provide learning models to perform complex tasks. Boosted by Machine Learning as a Service (MLaaS), the number of applications relying on ML capabilities is ever increasing. However, ML models are the source of different privacy violations through passive or active attacks from different entities. In this paper, we present MixNN a proxy-based privacy-preserving system for federated learning to protect the privacy of participants against a curious or malicious aggregation server trying to infer sensitive information (i.e., membership and attribute inferences). MixNN receives the model updates from participants and mixes layers between participants before sending the mixed updates to the aggregation server. This mixing strategy drastically reduces privacy leaks without any trade-off with utility. Indeed, mixing the updates of the model has no impact on the result of the aggregation of the updates computed by the server. We report on an extensive evaluation of MixNN using several datasets and neural networks architectures to quantify privacy leakage through membership and attribute inference attacks as well the robustness of the protection. We show that MixNN significantly limits both the membership and attribute inferences compared to a baseline using model compression and noisy gradient (well known to damage the utility) while keeping the same level of utility as classic federated learning.
MixNN (49).pdf (1.64 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03795818 , version 1 (04-10-2022)

Identifiants

Citer

Thomas Lebrun, Antoine Boutet, Jan Aalmoes, Adrien Baud. MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers. MIDDLEWARE 2022 - 23rd ACM/IFIP International Middleware Conference, Nov 2022, Quebec, Canada. pp.1-11, ⟨10.1145/3528535.3565240⟩. ⟨hal-03795818⟩
75 Consultations
109 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More