The context of new media art for photography generation based on diffusion models
Abstract
To further improve the controllability and artistic expressiveness of photography generation in new media art creation, this study proposes a multi-level conditional control generation framework based on diffusion models. The framework constructs three-level conditional fusion methods of semantics, layout and style. It integrates Contrastive Language-Image Pre-training (CLIP) text guidance, spatial structure feature mapping and style loss optimization into the Latent Diffusion Model (LDM). Meanwhile, this study introduces self-attention mechanism and consistency loss to enhance the spatial coherence of generated images. Experimental results show that the Fréchet Inception Distance (FID) value of the patterns generated by the model is 15.3, the Inception Score (IS) value is 28.7, and the CLIP Score is 0.312, which are better than those of baseline models such as Stable Diffusion 1.5. The results of ablation experiments show that the layout control and style control modules play a key role in the generation quality of the model. After removing the layout control, the FID value of the model increases to 17.2. After removing the style control, the visual realism of the generated patterns decreases. The above results indicate that the proposed framework can generate photography works with both high visual quality and high artistic matching degree. This provides a new technical path for new media art creation, and also promotes the development of generation models in semantic…
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.