Cryptology ePrint Archive: Report 2021/966

Soteria: Privacy-Preserving Machine Learning for Apache Spark

Clįudia Brito and Pedro Ferreira and Bernardo Portela and Rui Oliveira and Joćo Paulo

Abstract: Privacy and security are prime obstacles to the wider adoption of machine learning services offered by cloud computing providers. Namely, trusting users' sensitive data to a third-party infrastructure, vulnerable to both external and internal malicious attackers, restricts many companies from leveraging the scalability and flexibility offered by cloud services. We propose Soteria, a system for distributed privacy-preserving machine learning that combines the Apache Spark system, and its machine learning library (MLlib), with the confidentiality features provided by Trusted Execution Environments (e.g., Intel SGX). Soteria supports two main designs, each offering specific guarantees in terms of security and performance. The first encapsulates most of the computation done by Apache Spark on a secure enclave, thus offering stronger security. The second fine-tunes the Spark operations that must be done at the secure enclave to reduce the needed trusted computing base, and consequently the performance overhead, at the cost of an increased attack surface. An extensive evaluation of Soteria, with classification, regression, dimensionality reduction, and clustering algorithms, shows that our system outperforms state-of-the-art solutions, reducing their performance overhead by up to 41%. Moreover, we show that privacy-preserving machine learning is achievable while providing strong security guarantees.

Category / Keywords: Privacy-preserving Machine Learning, Apache Spark, Confidential Computing, Intel SGX

Date: received 17 Jul 2021

Contact author: claudia v brito at inesctec pt, joao t paulo at inesctec pt

Available format(s): PDF | BibTeX Citation

Version: 20210722:091436 (All versions of this report)

Short URL:

[ Cryptology ePrint archive ]