Adam Bataineh MD
@dradamb.bsky.social
founder of numenor.health (previously cofounder of Span - acquired by Eight Sleep)
I wonder how much of the improvement in performance is because of goodhart's law
“When a measure becomes a target, it ceases to be a good measure”
I.e. is better performance on benchmark tests translatable to real world performance?
“When a measure becomes a target, it ceases to be a good measure”
I.e. is better performance on benchmark tests translatable to real world performance?
December 23, 2024 at 3:07 PM
I wonder how much of the improvement in performance is because of goodhart's law
“When a measure becomes a target, it ceases to be a good measure”
I.e. is better performance on benchmark tests translatable to real world performance?
“When a measure becomes a target, it ceases to be a good measure”
I.e. is better performance on benchmark tests translatable to real world performance?