@saofk.bsky.social
Reposted
Have you ever done a dense grid search over neural network hyperparameters? Like a *really dense* grid search? It looks like this (!!). Blueish colors correspond to hyperparameters for which training converges, redish to those for which training diverges.
Even better, a video: vimeo.com/903855670
Even better, a video: vimeo.com/903855670
February 12, 2024 at 5:38 AM
Have you ever done a dense grid search over neural network hyperparameters? Like a *really dense* grid search? It looks like this (!!). Blueish colors correspond to hyperparameters for which training converges, redish to those for which training diverges.
Even better, a video: vimeo.com/903855670
Even better, a video: vimeo.com/903855670