### Privacy-Preserving Classification on Deep Neural Network

Hervé Chabanne, Amaury de Wargny, Jonathan Milgram, Constance Morel, and Emmanuel Prouff

##### Abstract

Neural Networks (NN) are today increasingly used in Machine Learning where they have become deeper and deeper to accurately model or classify high-level abstractions of data. Their development however also gives rise to important data privacy risks. This observation motives Microsoft researchers to propose a framework, called Cryptonets. The core idea is to combine simplifications of the NN with Fully Homomorphic Encryptions (FHE) techniques to get both confidentiality of the manipulated data and efficiency of the processing. While efficiency and accuracy are demonstrated when the number of non-linear layers is small (eg $2$), Cryptonets unfortunately becomes ineffective for deeper NNs which let the problem of privacy preserving matching open in these contexts. This work successfully addresses this problem by combining the original ideas of Cryptonets' solution with the batch normalization principle introduced at ICML 2015 by Ioffe and Szegedy. We experimentally validate the soundness of our approach with a neural network with $6$ non-linear layers. When applied to the MNIST database, it competes the accuracy of the best non-secure versions, thus significantly improving Cryptonets.

Note: Presented at Real World Cryptography 2017

Available format(s)
Category
Applications
Publication info
Preprint. MINOR revision.
Keywords
Machine LearningFHE
Contact author(s)
emmanuel prouff @ safrangroup com
History
2017-03-24: last of 3 revisions
See all versions
Short URL
https://ia.cr/2017/035

CC BY

BibTeX

@misc{cryptoeprint:2017/035,
author = {Hervé Chabanne and Amaury de Wargny and Jonathan Milgram and Constance Morel and Emmanuel Prouff},
title = {Privacy-Preserving Classification on Deep Neural Network},
howpublished = {Cryptology ePrint Archive, Paper 2017/035},
year = {2017},
note = {\url{https://eprint.iacr.org/2017/035}},
url = {https://eprint.iacr.org/2017/035}
}

Note: In order to protect the privacy of readers, eprint.iacr.org does not use cookies or embedded third party content.