Evidence Hub

Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection

Qinbin Li, Zeyi Wen, Bingsheng He

arXiv (Cornell University), 2019

70 citations

Abstract

Federated learning has been a hot research area in enabling the collaborative

training of machine learning models among different organizations under the

privacy restrictions. As researchers try to support more machine learning

models with different privacy-preserving approaches, there is a requirement in

developing systems and infrastructures to ease the development of various

federated learning algorithms. Just like deep learning systems such as Caffe,

PyTorch, and Tensorflow that boost the development of deep learning algorithms,

federated learning systems are equivalently important, and face challenges from

various issues such as unpractical system assumptions, scalability and

efficiency. Inspired by federated systems in other fields such as databases and

cloud computing, we investigate the existing characteristics of federated

learning systems. We find that two important features for federated systems in

other fields, i.e., heterogeneity and autonomy, are rarely considered in the

existing federated learning systems. Moreover, we provide a thorough

categorization for federated learning systems according to six different

aspects, including data partition, machine learning model, privacy mechanism,

communication architecture, scale of federation and motivation of federation.

The categorization can help the design of federated learning systems as shown

in our case studies. Lastly, we take a systematic comparison among the existing

federated learning systems and present…

Read the paper

Related studies

Go deeper in Evidence Hub

Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.

Open this study Sign up free