Dream Your Pose: Robust Human Pose Generation via Uncertainty-Aware Structural Reward Modeling
Abstract
Abstract Conditional diffusion models offer a versatile paradigm for controllable image synthesis, yet faithfully adhering to intricate spatial constraints, such as human pose skeletons, continues to pose significant challenges. Despite progress in control architectures and reward-guided fine-tuning, outputs frequently exhibit structural aberrations, joint misalignments, and anatomically infeasible configurations. We contend that these shortcomings arise primarily from two core deficiencies: pixel-based rewards inadequately encapsulate the perceptual and topological nuances of skeletal forms, and reward signals grow unreliable amid diverse or out-of-distribution samples.To address this, we introduce Dream Your Pose , a perceptually informed framework for pose-conditioned generation that prioritizes structural fidelity. Our method incorporates a multi-channel, structure-sensitive reward mechanism, harnessing perceptual features like local contrast, edge gradients, and spatial continuity to more accurately gauge pose congruence. Critically, we integrate an uncertainty-aware regularization paradigm—drawing from principles of uncertainty modeling in learning—to adaptively modulate reward influence, thereby mitigating the effects of spurious or ambiguous feedback and fostering robust training dynamics.Rigorous evaluations on the OpenPose-ControlNet dataset reveal substantial gains, including a 25.3% relative uplift in Object Keypoint Similarity (OKS) and a 15.6% enhancement in…
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.