@bearseascape.bsky.social
🚨 New paper w/ @nsubramani23.bsky.social !
In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs.
But models today are >>100x larger, trained on vastly more data…
Do they still rediscover the classical NLP pipeline? 🧵
In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs.
But models today are >>100x larger, trained on vastly more data…
Do they still rediscover the classical NLP pipeline? 🧵
October 22, 2025 at 7:09 AM
🚨 New paper w/ @nsubramani23.bsky.social !
In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs.
But models today are >>100x larger, trained on vastly more data…
Do they still rediscover the classical NLP pipeline? 🧵
In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs.
But models today are >>100x larger, trained on vastly more data…
Do they still rediscover the classical NLP pipeline? 🧵
🚨New #interpretability paper with @nsubramani23.bsky.social: 🕵️ Model Internal Sleuthing: Finding Lexical Identity and Inflectional Morphology in Modern Language Models
June 4, 2025 at 5:19 PM
🚨New #interpretability paper with @nsubramani23.bsky.social: 🕵️ Model Internal Sleuthing: Finding Lexical Identity and Inflectional Morphology in Modern Language Models