Sean Trott
@seantrott.bsky.social
Reposted by Sean Trott
A confounding thing for the linguistics of LMs: the best way to assess their grammatical ability is string probability. Yet string probability and grammaticality are famously not the same!
Really excited to have this out, where we give a formal account, w/ experiments, of how to make sense of that!
Really excited to have this out, where we give a formal account, w/ experiments, of how to make sense of that!
New work to appear @ TACL!
Language models (LMs) are remarkably good at generating novel well-formed sentences, leading to claims that they have mastered grammar.
Yet they often assign higher probability to ungrammatical strings than to grammatical strings.
How can both things be true? 🧵👇
Language models (LMs) are remarkably good at generating novel well-formed sentences, leading to claims that they have mastered grammar.
Yet they often assign higher probability to ungrammatical strings than to grammatical strings.
How can both things be true? 🧵👇
November 10, 2025 at 10:23 PM
A confounding thing for the linguistics of LMs: the best way to assess their grammatical ability is string probability. Yet string probability and grammaticality are famously not the same!
Really excited to have this out, where we give a formal account, w/ experiments, of how to make sense of that!
Really excited to have this out, where we give a formal account, w/ experiments, of how to make sense of that!
Reposted by Sean Trott
Hard to process the news about Harvard and international students. Other universities should stand in solidarity with our colleagues who are being persecuted.
May 23, 2025 at 4:40 AM
Hard to process the news about Harvard and international students. Other universities should stand in solidarity with our colleagues who are being persecuted.
Reposted by Sean Trott
Please read my essay in TIME, which @science.org
did not do carefully before publishing this assertion. time.com/7285045/resi...
did not do carefully before publishing this assertion. time.com/7285045/resi...
Why I’m Resigning from the NSF and Library of Congress
I cannot participate in systems that require dishonesty as the price of belonging.
time.com
May 14, 2025 at 4:23 PM
Please read my essay in TIME, which @science.org
did not do carefully before publishing this assertion. time.com/7285045/resi...
did not do carefully before publishing this assertion. time.com/7285045/resi...
Reposted by Sean Trott
My awesome colleague @seantrott.bsky.social quoted on understanding the nature of our new robot overlords in @nytimes.com
www.nytimes.com/2024/12/16/o...
www.nytimes.com/2024/12/16/o...
Opinion | How Does A.I. Think? Here’s One Theory.
It may employ a kind of reasoning humans use all the time — but you’ve probably never heard of it.
www.nytimes.com
December 17, 2024 at 6:12 AM
My awesome colleague @seantrott.bsky.social quoted on understanding the nature of our new robot overlords in @nytimes.com
www.nytimes.com/2024/12/16/o...
www.nytimes.com/2024/12/16/o...