FedHyperM: Modality-Sensitive Federated Hypergraph Learning for Heterogeneous Multimodal Edge Intelligence
Abstract
Abstract Federated learning enables edge devices to collaboratively train models in edge–cloud environments without sharing raw sensor data. In practical edge deployments, however, devices often have access to different subsets of modalities due to hardware heterogeneity, varying sensing conditions, or temporary sensor failures. Such modality heterogeneity makes conventional federated aggregation unreliable, as parameters learned from different modality evidence may not be directly comparable. Meanwhile, this setting also raises privacy concerns, since image, depth, and signal data may reveal sensitive user or environmental information. To address these challenges, we propose FedHyperM, a privacy-preserving federated multimodal learning framework for edge devices. FedHyperM performs hypergraph-based multimodal prediction by treating modality-specific features as nodes and adaptively constructing hyperedges to capture high-order correlations among multimodal features. On the cloud server, FedHyperM further introduces modality-sensitive aggregation (MSA), which uses the minimum edit distance (MinED) between available modality names to weight uploaded hypergraph learning parameters during aggregation. Experiments on the UR-FALL dataset under different modality existence rate (MER) settings demonstrate that FedHyperM consistently outperforms representative federated multimodal baselines, including FedAvg, FedCor, FedProx, AutoFed, and FedInMM. Compared with the five baselines,…
Read the paper
Related studies
- Active Learning during Federated Learning for Object Detection
- Fairness-aware federated learning
- Decentralized Federated Learning
- Building a Personally Identifiable Information Recognizer in a Privacy Preserved Manner Using Automated Annotation and Federated Learning
- Preservation of Patient Level Privacy: Federated Classification and Calibration Models
- Efficient explainable federated learning
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.