Evidence Hub

Investigating Safety Compliance for Image Generation Models

Chuancheng Shi

The Sydney eScholarship Repository (The University of Sydney), 2026

Abstract

Text-to-Image (T2I) diffusion models have advanced rapidly, yet safe deployment remains challenging. T2I safety is multi-dimensional, involving bias, privacy, copyright, robustness, harmful-content control, and structural reliability. This thesis focuses on two urgent problems: anatomical reliability in human images and suppression of unsafe content. These dimensions are complementary: a model may avoid harmful concepts while still producing invalid human structures, or generate plausible humans while remaining unsafe. First, we address anatomical failures, especially distorted or incomplete hands under complex poses and occlusions. Such defects reduce user trust and limit downstream use. We propose SGMHand, a structure-guided inpainting framework with a Structure-Guided Modulation module and a Keypoint-Aware loss. By injecting skeletal and depth priors into denoising, SGMHand guides generation toward anatomically valid topology. Experiments across diffusion backbones show that it reduces fused fingers and implausible poses while preserving consistency and prompt faithfulness. Second, we study risk control for pornographic and violent imagery. Existing concept-erasure methods often damage benign semantics, causing over-erasure and quality loss. We propose OrthoEraser, which formulates erasure as geometric projection. Sparse Autoencoders disentangle latent activations and identify sensitive neurons, after which intervention directions are projected into the null space of…

Read the paper

Related studies

Go deeper in Evidence Hub

Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.

Open this study Sign up free