www.dianacai.com
"Fisher meets Feynman: score-based variational inference with a product of experts" (NeurIPS spotlight)
with Robert Gower, David Blei, and Lawrence Saul
@flatironinstitute.org #NeurIPS2025
"Fisher meets Feynman: score-based variational inference with a product of experts" (NeurIPS spotlight)
with Robert Gower, David Blei, and Lawrence Saul
@flatironinstitute.org #NeurIPS2025
I design methods that guide what to measure next in costly experiments and simulations, e.g., in materials design, including physics-aware active search algorithms to accelerate stability predictions, and in genomics.
I design methods that guide what to measure next in costly experiments and simulations, e.g., in materials design, including physics-aware active search algorithms to accelerate stability predictions, and in genomics.
I develop black-box probabilistic inference algorithms, including:
* Fast, flexible variational inference via score matching
* MCMC including for costly scientific simulations
* Simulation-based inference in misspecified & hierarchical settings
I develop black-box probabilistic inference algorithms, including:
* Fast, flexible variational inference via score matching
* MCMC including for costly scientific simulations
* Simulation-based inference in misspecified & hierarchical settings
I design and analyze probabilistic machine-learning methods---motivated by real-world scientific constraints, and developed in collaboration with scientists in biology, chemistry, and physics.
A few highlights of my research areas are:
I design and analyze probabilistic machine-learning methods---motivated by real-world scientific constraints, and developed in collaboration with scientists in biology, chemistry, and physics.
A few highlights of my research areas are:
It expresses a product of multiple fractions as an integral over the simplex.
➡️ The PoE becomes a continuous mixture of t's & then gives us a way to estimate Z and sample from the PoE
It expresses a product of multiple fractions as an integral over the simplex.
➡️ The PoE becomes a continuous mixture of t's & then gives us a way to estimate Z and sample from the PoE
Products of experts (PoEs) are powerful -- but the normalizing constant Z is usually intractable and sampling is hard.
Products of experts (PoEs) are powerful -- but the normalizing constant Z is usually intractable and sampling is hard.
We use score matching and a trick from quantum field theory to make a product-of-experts family both expressive and efficient for variational inference.
To appear as a spotlight @ NeurIPS 2025.
#NeurIPS2025 (link below)
We use score matching and a trick from quantum field theory to make a product-of-experts family both expressive and efficient for variational inference.
To appear as a spotlight @ NeurIPS 2025.
#NeurIPS2025 (link below)
Previously we showed how to fit a full cov Gaussian approx via “batch and (score) match.” Here we show how to make the update cheaper using a “patch” step that projects the update to one that is low rank + diagonal.
Previously we showed how to fit a full cov Gaussian approx via “batch and (score) match.” Here we show how to make the update cheaper using a “patch” step that projects the update to one that is low rank + diagonal.
Friday 7:30pm, East Exhibit Hall A-C #3900
Link: arxiv.org/abs/2410.24054
Friday 7:30pm, East Exhibit Hall A-C #3900
Link: arxiv.org/abs/2410.24054
orthogonal function expansions
Link: arxiv.org/abs/2410.24054
Poster: Friday 7:30pm, East Exhibit Hall A-C #3900
orthogonal function expansions
Link: arxiv.org/abs/2410.24054
Poster: Friday 7:30pm, East Exhibit Hall A-C #3900