Cory Shain
@coryshain.bsky.social
Language in minds, brains, and machines. Linguistics prof
@Stanford. He/him. https://climblab.org/
@Stanford. He/him. https://climblab.org/
Reposted by Cory Shain
Finishing up with Senior Area Chair Highlights (1/9)
November 10, 2025 at 3:45 AM
Finishing up with Senior Area Chair Highlights (1/9)
Session 5: "BabyLM’s First Constructions." In a companion paper to the first one, we show that much of this constructional knowledge is even present in "babyLMs" with more developmentally plausible amounts of training: arxiv.org/abs/2506.02147. w/ @weissweiler.bsky.social
BabyLM's First Constructions: Causal probing provides a signal of learning
Construction grammar posits that language learners acquire constructions (form-meaning pairings) from the statistics of their environment. Recent work supports this hypothesis by showing sensitivity…
arxiv.org
November 2, 2025 at 9:57 PM
Session 5: "BabyLM’s First Constructions." In a companion paper to the first one, we show that much of this constructional knowledge is even present in "babyLMs" with more developmentally plausible amounts of training: arxiv.org/abs/2506.02147. w/ @weissweiler.bsky.social
Session 4: "Constructions are Revealed in Word Distributions." We show that rich knowledge of syntactic constructions in masked language models (MLMs) is revealed by patterns of contextual constraint. arxiv.org/abs/2503.06048. w/ @weissweiler.bsky.social + @kmahowald.bsky.social
Constructions are Revealed in Word Distributions
Construction grammar posits that constructions, or form-meaning pairings, are acquired through experience with language (the distributional learning hypothesis). But how much information about…
arxiv.org
November 2, 2025 at 9:57 PM
Session 4: "Constructions are Revealed in Word Distributions." We show that rich knowledge of syntactic constructions in masked language models (MLMs) is revealed by patterns of contextual constraint. arxiv.org/abs/2503.06048. w/ @weissweiler.bsky.social + @kmahowald.bsky.social