Adam Bataineh MD
dradamb.bsky.social
Adam Bataineh MD
@dradamb.bsky.social
founder of numenor.health (previously cofounder of Span - acquired by Eight Sleep)
This seems especially relevant for real world cases which are full of extra information that is not necessary to reach an accurate conclusion

but often lead to inaccuracies/distractions in LLM outputs
December 23, 2024 at 3:07 PM
A team at Apple recently published a really interesting paper where they tested LLM performance with GSM (a standard benchmark test for mathematical reasoning ability)

they modified the questions with unnecessary information to distract the LLMs

It led to much lower accuracy even for o1
December 23, 2024 at 3:07 PM