S4S-Alt achieves a 1.5-2x improvement over a “vanilla” diffusion ODE solver, particularly with few NFEs, and achieves SOTA performance for techniques that do not modify the underlying DM, while being competitive with training-based methods for a fraction of a compute cost!

6/

Furthermore, to fully explore the DM solver design space, we learn both the discretization steps and the solver coefficients with S4S-Alt, which proceeds through alternating minimization, giving even further quality improvements.

5/

In S4S, we directly learn the coefficients for any diffusion solver by minimizing the global error in the final generated sample. S4S consistently outperforms traditional ODE solvers across model architectures and time discretizations, especially in the few-step regime.

4/

Want to quickly sample high-quality images from diffusion models, but can’t afford the time or compute to distill them? Introducing S4S, or Solving for the Solver, which learns the coefficients and discretization steps for a DM solver to improve few-NFE generation.

Thread 👇 1/