Abstract

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.
Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 30 (NIPS 2017)
EditorsI. Guyon, U.V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett
Number of pages10
Volume30
PublisherNEURAL INFORMATION PROCESSING SYSTEMS (NIPS)
Publication date2017
Publication statusPublished - 2017
MoE publication typeA4 Article in conference proceedings
EventAnnual Conference on Neural Information Processing Systems - Long Beach, United States
Duration: 4 Dec 20179 Dec 2017
Conference number: 31
http://nips.cc/Conferences/2017

Publication series

NameAdvances in Neural Information Processing Systems
PublisherNEURAL INFORMATION PROCESSING SYSTEMS (NIPS)
Volume30
ISSN (Print)1049-5258

Fields of Science

  • NOISE
  • 112 Statistics and probability
  • 113 Computer and information sciences

Cite this

Heikkila, M., Lagerspetz, E., Kaski, S., Shimizu, K., Tarkoma, S., & Honkela, A. (2017). Differentially private Bayesian learning on distributed data. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in Neural Information Processing Systems 30 (NIPS 2017) (Vol. 30). (Advances in Neural Information Processing Systems; Vol. 30). NEURAL INFORMATION PROCESSING SYSTEMS (NIPS).