Doing naive distillation with noise/image pairs will give straight paths (on any diffusion/FM model).
After training doing Reflow from rectified flow will also indeed straighten paths.
Doing naive distillation with noise/image pairs will give straight paths (on any diffusion/FM model).
After training doing Reflow from rectified flow will also indeed straighten paths.
- FM schedule (often omitted "OT") is straight to a single point (possibly with tiny noise).
- Unfortunately, that does not guarantee straightness between distributions.
- FM schedule (often omitted "OT") is straight to a single point (possibly with tiny noise).
- Unfortunately, that does not guarantee straightness between distributions.
Note whatever schedule (alpha/sigma, VP, VE, FM) we pick, DDIM always ends up at the same spot:
- DDIM is invariant to alpha/sigma rescalings
- With FM schedule, sampling with either DDIM and Euler (=what FM uses) is the same.
Note whatever schedule (alpha/sigma, VP, VE, FM) we pick, DDIM always ends up at the same spot:
- DDIM is invariant to alpha/sigma rescalings
- With FM schedule, sampling with either DDIM and Euler (=what FM uses) is the same.