Reposted by rami
Here's another oldie from 2020: an entire blog post about the weirdness of high-dimensional probability distributions.
With generative modelling having taken off as it has, understanding typicality and its implications is all the more important, but it still isn't talked about much in ML circles!
With generative modelling having taken off as it has, understanding typicality and its implications is all the more important, but it still isn't talked about much in ML circles!
Musings on typicality
A summary of my current thoughts on typicality, and its relevance to likelihood-based generative models.
sander.ai
November 22, 2024 at 12:25 AM
Here's another oldie from 2020: an entire blog post about the weirdness of high-dimensional probability distributions.
With generative modelling having taken off as it has, understanding typicality and its implications is all the more important, but it still isn't talked about much in ML circles!
With generative modelling having taken off as it has, understanding typicality and its implications is all the more important, but it still isn't talked about much in ML circles!