Linguistics PhD student @jacksonpetty.org finds LLMs "quiet-quit" when instructions get long, switching from reasoning to guesswork.

With CDS' @tallinzen.bsky.social, @shauli.bsky.social, @lambdaviking.bsky.social, @michahu.bsky.social, and Wentao Wang.

nyudatascience.medium.com/llms-switch-...

you’re telling me a star spangled this banner??

I'm hiring at least one post-doc! We're interested in creating language models that process language more like humans than mainstream LLMs do, through architectural modifications and interpretability-style steering. Express interest here: docs.google.com/forms/d/e/1F...

How well can LLMs understand tasks with complex sets of instructions? We investigate through the lens of RELIC: REcognizing (formal) Languages In-Context, finding a significant overhang between what LLMs are able to do theoretically and how well they put this into practice.

[guy who only watched the pilot episode of Caprica voice] Nice!

Looking forward to speaking tomorrow (Tues am) in this Simons workshop in Berkeley simons.berkeley.edu/workshops/ll.... Will talk about some empirical work and also share some takes from this recent preprint from me and @futrell.bsky.social arxiv.org/abs/2501.17047

@foodnoms.com Can I submit a feature request on bsky? It would be amazing if we could tie Goals to bodyweight, as read in from Apple Health data. Many recommendations for daily protein intake, for instance, are given in grams/kg of bodyweight.

Eighth night // Dedication of the House (Shimen Frug)

Seventh night // Dedication of the House (Shimen Frug)

Happy Hanukkah

shabbat shalom

בימים ההם בזמן הזה

Accidentally bought tickets to the Sing Along version of Nosferatu 😑

Happy Hanukkah

Later on, we'll compile,
As we train on The Pile,
To autoregress
The next words we'll guess
Grokking in the latent feature land

I think 2m43s is a new personal record

o3, o3 in the loop,
list the steps in making soup

Well one couldn't help but become mildly sensitive to the context over there!

“You’re telling me a Tree Adjoined this Grammar??” — @bob-frank.bsky.social

Claude understood the assignment (a bit too well)

I get why conservatives dislike much of academia, however even taking into account academia's excesses, I resent their parochial approach because it disregards at a fundamental level what academia pretends: that everything is worthy of analysis.

URL verification works fine. The bigger issue is that people are reluctant to use a URL as their handle without the ability to reserve the *.bsky.social version and have it redirect

Of all sad words of tongue or pen, the saddest are these:

People who regularly use emojis, please choose the following sentence which is least acceptable.

1️⃣ <a href="https://poll.blue/p/b5OvdI/1" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">🫵 said that 🫵 would help me!
2️⃣ <a href="https://poll.blue/p/b5OvdI/2" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">🫵 said that you would help me!
3️⃣ <a href="https://poll.blue/p/b5OvdI/3" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">You said that 🫵 would help me!
4️⃣ <a href="https://poll.blue/p/b5OvdI/4" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">I have no judgments on this

📊 Show results