Dynamic Differential Privacy for Federated Learning
Abstract
This paper presents a novel approach to differential privacy in federated learning, termed Dynamic Differential Privacy (DDP). The core idea is to adapt the privacy budget dynamically, responding to the varying sensitivity of local data. Traditional federated learning frequently utilizes a static privacy budget, which can lead to either overly conservative privacy protection, significantly impacting model accuracy, or insufficient protection when confronted with malicious adversaries. DDP addresses these limitations by iteratively adjusting the privacy budget (ε, δ) based on gradient variance and update divergence. The algorithm reduces the privacy budget when gradients exhibit high variance, indicating sensitive data, and increases it when a node provides substantially different updates, signaling potential adversarial behavior. We demonstrate that this dynamic adaptation provides a stronger privacy guarantee while maintaining acceptable accuracy levels compared to fixed-budget approaches. This work contributes to a more robust and practical implementation of federated learning in privacy-sensitive environments.
Read the paper
Related studies
- Active Learning during Federated Learning for Object Detection
- Fairness-aware federated learning
- Decentralized Federated Learning
- Building a Personally Identifiable Information Recognizer in a Privacy Preserved Manner Using Automated Annotation and Federated Learning
- Preservation of Patient Level Privacy: Federated Classification and Calibration Models
- Efficient explainable federated learning
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.