On the Trajectory Regularity of ODE-based Diffusion Sampling
File version
Version of Record (VoR)
Author(s)
Zhou, Z
Wang, C
Shen, C
Lyu, S
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
Vienna, Austria
License
Abstract
Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior distribution. In this paper, we identify several intriguing trajectory properties in the ODE-based sampling process of diffusion models. We characterize an implicit denoising trajectory and discuss its vital role in forming the coupled sampling trajectory with a strong shape regularity, regardless of the generated content. We also describe a dynamic programming-based scheme to make the time schedule in sampling better fit the underlying trajectory structure. This simple strategy requires minimal modification to any given ODE-based numerical solvers and incurs negligible computational cost, while delivering superior performance in image generation, especially in 5 ∼ 10 function evaluations.
Journal Title
Conference Title
Proceedings of the 41st International Conference on Machine Learning
Book Title
Edition
Volume
235
Issue
Thesis Type
Degree Program
School
Publisher link
DOI
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
This work is covered by copyright. You must assume that re-use is limited to personal use and that permission from the copyright owner must be obtained for all other uses. If the document is available under a specified licence, refer to the licence for details of permitted re-use. If you believe that this work infringes copyright please make a copyright takedown request using the form at https://www.griffith.edu.au/copyright-matters.
Item Access Status
Note
Access the data
Related item(s)
Subject
Persistent link to this record
Citation
Chen, D; Zhou, Z; Wang, C; Shen, C; Lyu, S, On the Trajectory Regularity of ODE-based Diffusion Sampling, Proceedings of the 41st International Conference on Machine Learning, 2024, 235, pp. 7905-7934