On the Trajectory Regularity of ODE-based Diffusion Sampling

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Chen, D
Zhou, Z
Wang, C
Shen, C
Lyu, S
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location

Vienna, Austria

License
Abstract

Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior distribution. In this paper, we identify several intriguing trajectory properties in the ODE-based sampling process of diffusion models. We characterize an implicit denoising trajectory and discuss its vital role in forming the coupled sampling trajectory with a strong shape regularity, regardless of the generated content. We also describe a dynamic programming-based scheme to make the time schedule in sampling better fit the underlying trajectory structure. This simple strategy requires minimal modification to any given ODE-based numerical solvers and incurs negligible computational cost, while delivering superior performance in image generation, especially in 5 ∼ 10 function evaluations.

Journal Title
Conference Title

Proceedings of the 41st International Conference on Machine Learning

Book Title
Edition
Volume

235

Issue
Thesis Type
Degree Program
School
DOI
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

This work is covered by copyright. You must assume that re-use is limited to personal use and that permission from the copyright owner must be obtained for all other uses. If the document is available under a specified licence, refer to the licence for details of permitted re-use. If you believe that this work infringes copyright please make a copyright takedown request using the form at https://www.griffith.edu.au/copyright-matters.

Item Access Status
Note
Access the data
Related item(s)
Subject
Persistent link to this record
Citation

Chen, D; Zhou, Z; Wang, C; Shen, C; Lyu, S, On the Trajectory Regularity of ODE-based Diffusion Sampling, Proceedings of the 41st International Conference on Machine Learning, 2024, 235, pp. 7905-7934