Estimating Curvature of Data Manifolds with Diffusion Models
Abstract
In the quest to understand the geometry of data, curvature is a fundamental characterization. Differential geometry supplies many notions of curvature; this thesis presents exposition organizing a tree of curvature notions. Most importantly, we extend new research into a novel method harnessing diffusion models for estimating curvature from data. This new tool may aid in downstream applications such as shape analysis, learning theory, adversarial robustness, and more. The key novel contributions of this thesis are (i) the introduction of a diffusion model to learn the data manifold and probe its latent representation rather than the raw data, (ii) a comparison of previous estimation methods using quadratic regression and diffusion maps investigating how they deteriorate with increased noise and dimension, and (iii) a new approach using geodesic interpolations generated by a diffusion model to estimate more precise directions of curvature. Our findings on toy manifolds show that curvature estimation through a diffusion model proves more robust to noise, but this depends greatly on the fidelity of the diffusion model. Finally, we provide initial guesses at the curvature of small real world image datasets in the MNIST family, suggesting that these datasets might be relatively flat, which would be consistent with their empirical ease to learn.
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.