Multiobjective Evolutionary Diffusion Transformer Acceleration
Abstract
Diffusion Transformers (DiTs) have demonstrated outstanding performance in the field of image synthesis. However, the prohibitive computational overhead of model inference has been a major hurdle for deployment in low-latency scenarios. Based on the repetitive nature of the denoising process, we propose a multiobjective evolutionary algorithm for DiT acceleration, dubbed MEDA. Particularly, the conflict between the computational cost of the sampling process and the degradation in generation quality is explicitly modeled as a two-objective optimization problem, and similar intermediate features in adjacent sampling steps are stored and reused according to evolutionary-optimized schedules. Besides, a dynamic condition evaluation strategy is designed and incorporated into the evolutionary algorithm to maintain the generation performance of accelerated DiT models across different condition inputs. In addition, a latent objective normalization strategy is introduced to provide a bounded objective space for the evolution process. Experiments across various DiT architectures demonstrate that the proposed MEDA can significantly accelerate the sampling process while maintaining or even further enhancing generation quality relative to the original baseline models.
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.