Federated learning on non-IID data: A survey

[摘要] Federated learning is an emerging distributed machine learning framework for privacy preservation. However, models trained in federated learning usually have worse performance than those trained in the standard centralized learning mode, especially when the training data are not independent and identically distributed (Non-IID) on the local devices. In this survey, we provide a detailed analysis of the influence of Non-IID data on both parametric and non-parametric machine learning models in both horizontal and vertical federated learning. In addition, current research work on handling challenges of NonIID data in federated learning are reviewed, and both advantages and disadvantages of these approaches are discussed. Finally, we suggest several future research directions before concluding the paper. (c) 2021 Elsevier B.V. All rights reserved.

[发布日期] 2021-11-20

[关键词] Federated learning;Machine learning;Non-IID data;Privacy preservation