With llms acting as intelligent mutation operators, meta-optimization moves from purely quantitative exploration of pre-defined spaces (hyperparam search) to *qualitative* proposals (defining new loss functions, identifying target hyperparams, etc.)
With llms acting as intelligent mutation operators, meta-optimization moves from purely quantitative exploration of pre-defined spaces (hyperparam search) to *qualitative* proposals (defining new loss functions, identifying target hyperparams, etc.)