Molei Tao
@moleitaomath.bsky.social
Georgia Tech Prof; Tsinghua (Math+Phys), Caltech (Control & Dynamical Systems), NYU Courant (Applied & Computational Math)
* deep learning theory
* (diffusion) generative model, probabilistic machine learning
* AI4Science
* deep learning theory
* (diffusion) generative model, probabilistic machine learning
* AI4Science
If you know data live on a manifold, you can hardwire this prior knowledge in diffusion model to make generation more accurate & data efficient.
What if there is also a group structure, like in protein design & quantum problem? Use it to do even better -
itsdynamical.github.io/article/2025...
What if there is also a group structure, like in protein design & quantum problem? Use it to do even better -
itsdynamical.github.io/article/2025...
Diffusion Generative Model, Non-Euclidean Data, and How the Algebraic/Geometric Structure of Lie Groups Helps
TL;DR It is challenging but beneficial to create diffusion generative model on manifolds. By algorithmically introducing an auxiliary momentum variable and mathematically “trivializing” it, this task ...
itsdynamical.github.io
April 15, 2025 at 3:24 PM
If you know data live on a manifold, you can hardwire this prior knowledge in diffusion model to make generation more accurate & data efficient.
What if there is also a group structure, like in protein design & quantum problem? Use it to do even better -
itsdynamical.github.io/article/2025...
What if there is also a group structure, like in protein design & quantum problem? Use it to do even better -
itsdynamical.github.io/article/2025...
How to accelerate the inference of discrete diffusion model / improve its accuracy?
Please check out arxiv.org/abs/2502.00234 .
Grateful to have worked with a luxurious team of
Yinuo Ren, Haoxuan Chen, Yuchen Zhu, Wei Guo, Yongxin Chen, @grant.rotskoff.cc and @lexingying.bsky.social !
Please check out arxiv.org/abs/2502.00234 .
Grateful to have worked with a luxurious team of
Yinuo Ren, Haoxuan Chen, Yuchen Zhu, Wei Guo, Yongxin Chen, @grant.rotskoff.cc and @lexingying.bsky.social !
Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms
Discrete diffusion models have emerged as a powerful generative modeling framework for discrete data with successful applications spanning from text generation to image synthesis. However, their deplo...
arxiv.org
February 7, 2025 at 2:27 PM
How to accelerate the inference of discrete diffusion model / improve its accuracy?
Please check out arxiv.org/abs/2502.00234 .
Grateful to have worked with a luxurious team of
Yinuo Ren, Haoxuan Chen, Yuchen Zhu, Wei Guo, Yongxin Chen, @grant.rotskoff.cc and @lexingying.bsky.social !
Please check out arxiv.org/abs/2502.00234 .
Grateful to have worked with a luxurious team of
Yinuo Ren, Haoxuan Chen, Yuchen Zhu, Wei Guo, Yongxin Chen, @grant.rotskoff.cc and @lexingying.bsky.social !
Reposted by Molei Tao
Decision tree that has been sent to Program Officers at NSF
February 4, 2025 at 1:33 AM
Decision tree that has been sent to Program Officers at NSF
Reposted by Molei Tao
Looks to be a really nice read; clear that the man enjoys writing!
arxiv.org/abs/2501.00925
'Fisher Information in Kinetic Theory'
- Cédric Villani
arxiv.org/abs/2501.00925
'Fisher Information in Kinetic Theory'
- Cédric Villani
January 3, 2025 at 9:55 AM
Looks to be a really nice read; clear that the man enjoys writing!
arxiv.org/abs/2501.00925
'Fisher Information in Kinetic Theory'
- Cédric Villani
arxiv.org/abs/2501.00925
'Fisher Information in Kinetic Theory'
- Cédric Villani
Reposted by Molei Tao
FutureHouse is launching an independent postdoctoral fellowship program for exceptional researchers who want to apply our automated science tools to specific problems in biology and biochemistry, in collaboration with world-leading academic labs. 1/
December 19, 2024 at 3:29 PM
FutureHouse is launching an independent postdoctoral fellowship program for exceptional researchers who want to apply our automated science tools to specific problems in biology and biochemistry, in collaboration with world-leading academic labs. 1/
Reposted by Molei Tao
The slides of my NeurIPS lecture "From Diffusion Models to Schrödinger Bridges - Generative Modeling meets Optimal Transport" can be found here
drive.google.com/file/d/1eLa3...
drive.google.com/file/d/1eLa3...
BreimanLectureNeurIPS2024_Doucet.pdf
drive.google.com
December 15, 2024 at 6:40 PM
The slides of my NeurIPS lecture "From Diffusion Models to Schrödinger Bridges - Generative Modeling meets Optimal Transport" can be found here
drive.google.com/file/d/1eLa3...
drive.google.com/file/d/1eLa3...
I'll be at @neuripsconf.bsky.social presenting 4 papers.
And... anyone wants to chat about:
* diffusion model
* AI4Science (quantum, astronomy, molecule, computing...)
* deep learning theory
* dynamical systems, geometry, stochastic analysis, control, computational math?
Simply DM, reply or email!
And... anyone wants to chat about:
* diffusion model
* AI4Science (quantum, astronomy, molecule, computing...)
* deep learning theory
* dynamical systems, geometry, stochastic analysis, control, computational math?
Simply DM, reply or email!
December 6, 2024 at 2:25 PM
I'll be at @neuripsconf.bsky.social presenting 4 papers.
And... anyone wants to chat about:
* diffusion model
* AI4Science (quantum, astronomy, molecule, computing...)
* deep learning theory
* dynamical systems, geometry, stochastic analysis, control, computational math?
Simply DM, reply or email!
And... anyone wants to chat about:
* diffusion model
* AI4Science (quantum, astronomy, molecule, computing...)
* deep learning theory
* dynamical systems, geometry, stochastic analysis, control, computational math?
Simply DM, reply or email!
Reposted by Molei Tao
I have updated my course notes on Optimal Transport with a new Chapter 9 on Wasserstein flows. It includes 3 illustrative applications: training a 2-layer MLP, deep transformers, and flow-matching generative models. You can access it here: mathematical-tours.github.io/book-sources...
December 4, 2024 at 8:11 AM
I have updated my course notes on Optimal Transport with a new Chapter 9 on Wasserstein flows. It includes 3 illustrative applications: training a 2-layer MLP, deep transformers, and flow-matching generative models. You can access it here: mathematical-tours.github.io/book-sources...
Reposted by Molei Tao
If you're at NeurIPS next week come see our spotlight poster led by Yinuo Ren and Haoxuan Chen! We use the parallel sampling technique to rigorously establish a big acceleration for diffusion model inference! neurips.cc/virtual/2024...
NeurIPS Poster Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time ComplexityNeurIPS 2024
neurips.cc
December 3, 2024 at 9:55 PM
If you're at NeurIPS next week come see our spotlight poster led by Yinuo Ren and Haoxuan Chen! We use the parallel sampling technique to rigorously establish a big acceleration for diffusion model inference! neurips.cc/virtual/2024...
GT dynamical ML group is recruiting PhD students for Fall'25, in ML theory and/or AI4Science.
Interested and have Math/Phys/CS background? Please apply at grad.gatech.edu/admissions to either Math, ML, CSE, or ACO PhD program, mention my name & choose Math as home unit.
Repost is appreciated!
Interested and have Math/Phys/CS background? Please apply at grad.gatech.edu/admissions to either Math, ML, CSE, or ACO PhD program, mention my name & choose Math as home unit.
Repost is appreciated!
Admissions
Georgia Tech welcomes you! With over 1,000 universities in the United States that offer graduate degrees, we are honored that you are considering advancing your education at Tech.
grad.gatech.edu
November 27, 2024 at 2:58 PM
GT dynamical ML group is recruiting PhD students for Fall'25, in ML theory and/or AI4Science.
Interested and have Math/Phys/CS background? Please apply at grad.gatech.edu/admissions to either Math, ML, CSE, or ACO PhD program, mention my name & choose Math as home unit.
Repost is appreciated!
Interested and have Math/Phys/CS background? Please apply at grad.gatech.edu/admissions to either Math, ML, CSE, or ACO PhD program, mention my name & choose Math as home unit.
Repost is appreciated!