ExpoGenius: Robust Personalized Human Image Generation using Diffusion Model for Exposure Variation and Pose Transfer
Abstract
Diffusion models hold significant appeal within the realm of synthetic media generation and demonstrate exceptional performance in personalized human image generation. However, the efficiency of the existing approaches is hindered by their limited capacity to handle images captured under different exposure conditions as the models tend to incorrectly attribute the illumination of an individual's facial region to their complexion. In addition, previous methodologies encounter challenges in the realm of posture transfer due to the fact that their image encoders primarily emphasize the extraction of character identity. We introduces ExpoGenius, a framework that facilitates efficient and personalized human image generation for exposure variation and pose transfer, all accomplished without the need for fine-tuning. ExpoGenius employs Multi-Grained Identity Feature to extract and combine facial features that are not affected by varying lighting conditions, enabling the accurate representation of facial attributes in various diverse exposure levels. To facilitate the transfer of pose , we propose Pose Feature Injection to inject pose feature into our improved diffusion model with identity feature and textual embeddings. In scenarios where facial images occupy a relatively small proportion within an overall image, the accuracy of identity extraction may encounter challenges. ExpoGenius presents Adaptive Facial Loss which effectively enhances the accuracy of identity extraction. Our…
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.