LightNews LightNews
samibaral.bsky.social
@samibaral.bsky.social
3 followers 7 following 0 posts
Posts Replies Media Videos
Reposted
lucy3.bsky.social
New @ai2.bsky.social paper accepted to #NAACL2025! We worked with Teaching Lab and ASSISTments to create a new dataset for evaluating VLMs. DrawEduMath includes 2,030 teacher-annotated images of students’ handwritten responses to math problems.
Website: drawedumath.org
a screenshot of the drawedumath website, showing paper title Evaluating Vision Language Models with Expert-Annotated Students’ Hand-Drawn Math Images and author list Sami Baral, Li Lucy, Ryan Knight, Alice Ng, Luca Soldaini, Neil Heffernan, Kyle Lo with affiliations at WPI, Berkeley, Insource Services, Teaching Lab, and Ai2. Below that is an image showing an example image with question-answer pairs from the dataset.
January 29, 2025 at 1:59 AM