Cryptology ePrint Archive: Report 2018/1041

Secure Outsourced Matrix Computation and Application to Neural Networks

Xiaoqian Jiang and Miran Kim and Kristin Lauter and Yongsoo Song

Abstract: Homomorphic Encryption (HE) is a powerful cryptographic primitive to address privacy and security issues in outsourcing computation on sensitive data to an untrusted computation environment. Comparing to secure Multi-Party Computation (MPC), HE has advantages in supporting non-interactive operations and saving on communication costs. However, it has not come up with an optimal solution for modern learning frameworks, partially due to a lack of efficient matrix computation mechanisms.

In this work, we present a practical solution to encrypt a matrix homomorphically and perform arithmetic operations on encrypted matrices. Our solution includes a novel matrix encoding method and an efficient evaluation strategy for basic matrix operations such as addition, multiplication, and transposition. We also explain how to encrypt more than one matrix in a single ciphertext, yielding better amortized performance.

Our solution is generic in the sense that it can be applied to most of the existing HE schemes. It also achieves reasonable performance for practical use; for example, our implementation takes 9.21 seconds to multiply two encrypted square matrices of order 64 and 2.56 seconds to transpose a square matrix of order 64.

Our secure matrix computation mechanism has a wide applicability to our new framework EDM, which stands for encrypted data and encrypted model. To the best of our knowledge, this is the first work that supports secure evaluation of the prediction phase based on both encrypted data and encrypted model, whereas previous work only supported applying a plain model to encrypted data. As a benchmark, we report an experimental result to classify handwritten images using convolutional neural networks (CNN). Our implementation on the MNIST dataset takes 28.59 seconds to compute ten likelihoods of 64 input images simultaneously, yielding an amortized rate of 0.45 seconds per image.

Category / Keywords: Homomorphic encryption; matrix computation; machine learning; neural networks

Original Publication (in the same form): ACM SIGSAC Conference on Computer and Communications Security
DOI:
10.1145/3243734.3243837

Date: received 25 Oct 2018, last revised 30 Oct 2018

Contact author: miran kim at uth tmc edu

Available format(s): PDF | BibTeX Citation

Note: We revised the paper in the single-column format.

Version: 20181102:005015 (All versions of this report)

Short URL: ia.cr/2018/1041


[ Cryptology ePrint archive ]