Language models (LMs) are remarkably good at generating novel well-formed sentences, leading to claims that they have mastered grammar.
Yet they often assign higher probability to ungrammatical strings than to grammatical strings.
How can both things be true? 🧵👇
Language models (LMs) are remarkably good at generating novel well-formed sentences, leading to claims that they have mastered grammar.
Yet they often assign higher probability to ungrammatical strings than to grammatical strings.
How can both things be true? 🧵👇
New work with @kmahowald.bsky.social and @cgpotts.bsky.social!
🧵👇!
New work with @kmahowald.bsky.social and @cgpotts.bsky.social!
🧵👇!
1- We provide moderate evidence that processing of agreement errors is modulated by agreement type (internal vs external agr.)
1- We provide moderate evidence that processing of agreement errors is modulated by agreement type (internal vs external agr.)
A draft is up here. For anyone interested in thinking big about linguistics, we'd be happy to hear your thoughts!
arxiv.org/abs/2502.18313
#linguistics
A draft is up here. For anyone interested in thinking big about linguistics, we'd be happy to hear your thoughts!
arxiv.org/abs/2502.18313
#linguistics