Cryptology ePrint Archive: Report 2018/074

Secure Logistic Regression Based on Homomorphic Encryption: Design and Evaluation

Miran Kim and Yongsoo Song and Shuang Wang and Yuhou Xia and Xiaoqian Jiang

Abstract: Learning a model without accessing raw data has been an intriguing idea to the security and machine learning researchers for years. In an ideal setting, we want to encrypt sensitive data to store them on a commercial cloud and run certain analysis without ever decrypting the data to preserve the privacy. Homomorphic encryption technique is a promising candidate for secure data outsourcing but it is a very challenging task to support real-world machine learning tasks. Existing frameworks can only handle simplified cases with low-degree polynomials such as linear means classifier and linear discriminative analysis.

The goal of this study is to provide a practical support to the mainstream learning models (eg logistic regression). We adapted a novel homomorphic encryption scheme optimized for real numbers computation. We devised (1) the least squares approximation of the logistic function for accuracy and efficiency (ie reduce computation cost) and (2) new packing and parallelization techniques.

Using real-world datasets, we evaluated the performance of our model and demonstrated its feasibility in speed and memory consumption. For example, it took about 116 minutes to obtain the training model from homomorphically encrypted Edinburgh dataset. In addition, it gives fairly accurate predictions on the testing dataset. We present the first homomorphically encrypted logistic regression outsourcing model based on the critical observation that the precision loss of classification models is sufficiently small so that the decision plan stays still.

Category / Keywords: Homomorphic encryption, approximate arithmetic, logistic regression, gradient descent

Original Publication (with minor differences): JMIR Medical Informatics
DOI: 10.2196/medinform.8805

Date: received 16 Jan 2018, last revised 26 Mar 2018

Contact author: mrkim at ucsd edu

Available format(s): PDF | BibTeX Citation

Version: 20180326:214059 (All versions of this report)

Short URL: ia.cr/2018/074

Discussion forum: Show discussion | Start new discussion