Medical experts analyzed clinical dataset abstractions, uncovering issues like overuse of unspecified diagnoses.
This mirrors real-world updates to medical abstractions — showing how models can help us rethink human knowledge.
Medical experts analyzed clinical dataset abstractions, uncovering issues like overuse of unspecified diagnoses.
This mirrors real-world updates to medical abstractions — showing how models can help us rethink human knowledge.
By propagating the model's uncertainty through an abstraction graph, we can see how well it aligns with human knowledge.
E.g., confusing oaks🌳 with palms🌴 is more aligned than confusing oaks🌳 with sharks🦈.
By propagating the model's uncertainty through an abstraction graph, we can see how well it aligns with human knowledge.
E.g., confusing oaks🌳 with palms🌴 is more aligned than confusing oaks🌳 with sharks🦈.
But human reasoning is built on abstractions — relationships between concepts that help us generalize (wheels 🛞→ car 🚗).
To measure alignment, we must test if models learn human-like concepts AND abstractions.
But human reasoning is built on abstractions — relationships between concepts that help us generalize (wheels 🛞→ car 🚗).
To measure alignment, we must test if models learn human-like concepts AND abstractions.