Elisa Kreiss
@elisakreiss.bsky.social
Assistant Professor at UCLA. Alum @StanfordNLP. NLP, Cognitive Science, Accessibility. https://www.coalas-lab.com/elisakreiss
Pinned
Elisa Kreiss
@elisakreiss.bsky.social
· Nov 24
Reference-Based Metrics Are Biased Against Blind and Low-Vision Users’ Image Description Preferences
Rhea Kapur, Elisa Kreiss. Proceedings of the Third Workshop on NLP for Positive Impact. 2024.
aclanthology.org
I'm excited to kick off my Bluesky presence with wonderful news: Our paper "Reference-Based Metrics Are Biased Against Blind and Low-Vision Users' Image Description Preferences" won a Best Paper Award at the NLP for Positive Impact Workshop at EMNLP! Read it here: aclanthology.org/2024.nlp4pi-...
Reposted by Elisa Kreiss
Honored and excited to share that I am the winner of Nomis & Science Young Explorer Award!!
Also thrilled to share that my article describing my research is out now in @science.org today!
The normalization of (almost) everything www.science.org/doi/10.1126/...
1/
Also thrilled to share that my article describing my research is out now in @science.org today!
The normalization of (almost) everything www.science.org/doi/10.1126/...
1/
The normalization of (almost) everything: Our minds can get used to anything, and even crises start feeling normal
Our minds can get used to anything, and even crises start feeling normal
www.science.org
November 6, 2025 at 9:37 PM
Honored and excited to share that I am the winner of Nomis & Science Young Explorer Award!!
Also thrilled to share that my article describing my research is out now in @science.org today!
The normalization of (almost) everything www.science.org/doi/10.1126/...
1/
Also thrilled to share that my article describing my research is out now in @science.org today!
The normalization of (almost) everything www.science.org/doi/10.1126/...
1/
Reposted by Elisa Kreiss
Now that the ICLR deadline is behind us, happy to share that From Language to Cognition has been accepted as an Oral at #EMNLP2025! 🎉
Looking forward to seeing many of you in Suzhou 🇨🇳
Looking forward to seeing many of you in Suzhou 🇨🇳
🚨 New Preprint!!
LLMs trained on next-word prediction (NWP) show high alignment with brain recordings. But what drives this alignment—linguistic structure or world knowledge? And how does this alignment evolve during training? Our new paper explores these questions. 👇🧵
LLMs trained on next-word prediction (NWP) show high alignment with brain recordings. But what drives this alignment—linguistic structure or world knowledge? And how does this alignment evolve during training? Our new paper explores these questions. 👇🧵
September 25, 2025 at 2:56 PM
Now that the ICLR deadline is behind us, happy to share that From Language to Cognition has been accepted as an Oral at #EMNLP2025! 🎉
Looking forward to seeing many of you in Suzhou 🇨🇳
Looking forward to seeing many of you in Suzhou 🇨🇳
Reposted by Elisa Kreiss
For folks considering grad school in ML, my advice is to explore programs that mix ML with a domain interest. ML programs are wildly oversubscribed while a lot of the fun right now is in figuring out what you can do with it
September 25, 2025 at 3:25 AM
For folks considering grad school in ML, my advice is to explore programs that mix ML with a domain interest. ML programs are wildly oversubscribed while a lot of the fun right now is in figuring out what you can do with it
Reposted by Elisa Kreiss
Keynote spotlight #3: COLM's second day will open with some *real* intelligence 🧠🧠🧠 with Tom Griffiths from Princeton
September 18, 2025 at 4:17 PM
Keynote spotlight #3: COLM's second day will open with some *real* intelligence 🧠🧠🧠 with Tom Griffiths from Princeton
Reposted by Elisa Kreiss
I finally got around to making a tool to compare completions from SFT vs. RLHF trained models. This is a mini site for the RLHF book that I've wanted for a while.
buff.ly/lqDL5wa
It's always been hard to say what RLHF does to a model within a more complex post-training pipeline.
buff.ly/lqDL5wa
It's always been hard to say what RLHF does to a model within a more complex post-training pipeline.
September 17, 2025 at 2:20 PM
I finally got around to making a tool to compare completions from SFT vs. RLHF trained models. This is a mini site for the RLHF book that I've wanted for a while.
buff.ly/lqDL5wa
It's always been hard to say what RLHF does to a model within a more complex post-training pipeline.
buff.ly/lqDL5wa
It's always been hard to say what RLHF does to a model within a more complex post-training pipeline.
Reposted by Elisa Kreiss
Keynote spotlight #1:
COLM will open on Oct 7 with a keynote by
@lukezettlemoyer.bsky.social about mixed-modals models 🌈
COLM will open on Oct 7 with a keynote by
@lukezettlemoyer.bsky.social about mixed-modals models 🌈
September 16, 2025 at 7:30 PM
Keynote spotlight #1:
COLM will open on Oct 7 with a keynote by
@lukezettlemoyer.bsky.social about mixed-modals models 🌈
COLM will open on Oct 7 with a keynote by
@lukezettlemoyer.bsky.social about mixed-modals models 🌈
Reposted by Elisa Kreiss
It is again the time of year when I beg @aclmeeting.bsky.social execs to rethink the current streaming platform system. For my #EMNLP2025 submissions, I am *required* to upload 2 video recordings + 2 posters + 2 slide decks. Why force both posters and talks for all? Nonsense.
September 15, 2025 at 3:20 PM
It is again the time of year when I beg @aclmeeting.bsky.social execs to rethink the current streaming platform system. For my #EMNLP2025 submissions, I am *required* to upload 2 video recordings + 2 posters + 2 slide decks. Why force both posters and talks for all? Nonsense.
New paper! We find that the more prompts "look like" common benchmark tasks, the more model behavior changes. Even when we encourage the model to explicitly infer gender, the instruction itself causes the opposite, namely boosting gender-neutral language. Check out Bufan's thread and our paper!
🚨 New #EMNLP2025 paper!
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
September 12, 2025 at 8:47 PM
New paper! We find that the more prompts "look like" common benchmark tasks, the more model behavior changes. Even when we encourage the model to explicitly infer gender, the instruction itself causes the opposite, namely boosting gender-neutral language. Check out Bufan's thread and our paper!
Reposted by Elisa Kreiss
🚨 New #EMNLP2025 paper!
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
September 11, 2025 at 4:01 PM
🚨 New #EMNLP2025 paper!
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀
We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Reposted by Elisa Kreiss
We’re hiring @ucdavis.bsky.social Comm! TT Asst Prof in Mediated Interpersonal Communication. Our dept blends behavioral, biological & computational strengths at one of the most interdisciplinary campuses anywhere. Apps due Oct 15. Glad to chat recruit.ucdavis.edu/JPF07289
Department of Communication - Mediated Interpersonal Communication
University of California, Davis is hiring. Apply now!
recruit.ucdavis.edu
September 4, 2025 at 5:34 PM
We’re hiring @ucdavis.bsky.social Comm! TT Asst Prof in Mediated Interpersonal Communication. Our dept blends behavioral, biological & computational strengths at one of the most interdisciplinary campuses anywhere. Apps due Oct 15. Glad to chat recruit.ucdavis.edu/JPF07289
Reposted by Elisa Kreiss
My lab at UCLA is hiring 1-2 PhD students this cycle!
Join us to work at the intersection of cognitive science and AI applied to pressing societal challenges like climate change.
More info about me: rachit-dubey.github.io
My lab: ucla-cocopol.github.io
Please help repost/spread the word!
Join us to work at the intersection of cognitive science and AI applied to pressing societal challenges like climate change.
More info about me: rachit-dubey.github.io
My lab: ucla-cocopol.github.io
Please help repost/spread the word!
September 3, 2025 at 12:19 AM
My lab at UCLA is hiring 1-2 PhD students this cycle!
Join us to work at the intersection of cognitive science and AI applied to pressing societal challenges like climate change.
More info about me: rachit-dubey.github.io
My lab: ucla-cocopol.github.io
Please help repost/spread the word!
Join us to work at the intersection of cognitive science and AI applied to pressing societal challenges like climate change.
More info about me: rachit-dubey.github.io
My lab: ucla-cocopol.github.io
Please help repost/spread the word!
Reposted by Elisa Kreiss
How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669
August 29, 2025 at 9:46 PM
How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669
Reposted by Elisa Kreiss
Reposted by Elisa Kreiss
New paper! We explore a radical paradigm for AI evals: assessing LLMs on *unsolved* questions.
Instead of artificially difficult exams where progress ≠ value, we assess LLMs on organic, unsolved problems via reference-free LLM validation & community verification. LLMs solved ~10/500 so far:
Instead of artificially difficult exams where progress ≠ value, we assess LLMs on organic, unsolved problems via reference-free LLM validation & community verification. LLMs solved ~10/500 so far:
August 26, 2025 at 5:51 PM
New paper! We explore a radical paradigm for AI evals: assessing LLMs on *unsolved* questions.
Instead of artificially difficult exams where progress ≠ value, we assess LLMs on organic, unsolved problems via reference-free LLM validation & community verification. LLMs solved ~10/500 so far:
Instead of artificially difficult exams where progress ≠ value, we assess LLMs on organic, unsolved problems via reference-free LLM validation & community verification. LLMs solved ~10/500 so far:
Reposted by Elisa Kreiss
Preprint announcement! 🎉
I've written a short position paper with Cindy Xiong Bearfield (a bias researcher in visualization) for @ieeevis.bsky.social Workshop on Accessibility on how using LLMs and generative models forces reliance (rather than builds trust) when used for accessibility.
I've written a short position paper with Cindy Xiong Bearfield (a bias researcher in visualization) for @ieeevis.bsky.social Workshop on Accessibility on how using LLMs and generative models forces reliance (rather than builds trust) when used for accessibility.
Playing telephone with generative models: "verification disability," "compelled reliance," and accessibility in data visualization
This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibi...
arxiv.org
August 19, 2025 at 12:20 PM
Preprint announcement! 🎉
I've written a short position paper with Cindy Xiong Bearfield (a bias researcher in visualization) for @ieeevis.bsky.social Workshop on Accessibility on how using LLMs and generative models forces reliance (rather than builds trust) when used for accessibility.
I've written a short position paper with Cindy Xiong Bearfield (a bias researcher in visualization) for @ieeevis.bsky.social Workshop on Accessibility on how using LLMs and generative models forces reliance (rather than builds trust) when used for accessibility.
Reposted by Elisa Kreiss
UMich Ling is hiring for a cluster hire position in AI and Linguistics! Come work in a fabulous department with great grad students, supportive colleagues, and one overly school-spirited nut who will tell you where all the fun stuff is on campus.
apply.interfolio.com/171006
apply.interfolio.com/171006
Apply - Interfolio
{{$ctrl.$state.data.pageTitle}} - Apply - Interfolio
apply.interfolio.com
August 15, 2025 at 1:45 PM
UMich Ling is hiring for a cluster hire position in AI and Linguistics! Come work in a fabulous department with great grad students, supportive colleagues, and one overly school-spirited nut who will tell you where all the fun stuff is on campus.
apply.interfolio.com/171006
apply.interfolio.com/171006
Reposted by Elisa Kreiss
This is the first example I've seen of a university trying to mobilize constituents to stand up against Trump threats.
There's been a lot of "wHaT eLsE CaN AdMiNiStRaToRs Do?" in The Discourse when this is exactly the thing they haven't been doing. Good for UCLA for trying.
Others should follow.
There's been a lot of "wHaT eLsE CaN AdMiNiStRaToRs Do?" in The Discourse when this is exactly the thing they haven't been doing. Good for UCLA for trying.
Others should follow.
August 10, 2025 at 5:45 PM
This is the first example I've seen of a university trying to mobilize constituents to stand up against Trump threats.
There's been a lot of "wHaT eLsE CaN AdMiNiStRaToRs Do?" in The Discourse when this is exactly the thing they haven't been doing. Good for UCLA for trying.
Others should follow.
There's been a lot of "wHaT eLsE CaN AdMiNiStRaToRs Do?" in The Discourse when this is exactly the thing they haven't been doing. Good for UCLA for trying.
Others should follow.
Reposted by Elisa Kreiss
Really just had something like this feeling this afternoon. It’s the high that keeps you coming back for more
August 8, 2025 at 1:27 AM
Really just had something like this feeling this afternoon. It’s the high that keeps you coming back for more
Excellent non-technical explanation! Let’s raise AI literacy without scaring people off with overly complicated terminology while preserving technical accuracy!
Hi all. I whipped up a blog post that give non-technical intuition behind how LLMs and chatbots work.
mark-riedl.medium.com/the-intuitio...
It's a variation on a talk I've given a few times to K-12 teachers and other non-technical LLM users.
mark-riedl.medium.com/the-intuitio...
It's a variation on a talk I've given a few times to K-12 teachers and other non-technical LLM users.
The Intuition Behind How Large Language Models Work
Large Language Models (LLMs) are fancy artificial neural networks. But you don’t have time to learn the math or engineering. Unfortunately…
mark-riedl.medium.com
August 7, 2025 at 5:54 PM
Excellent non-technical explanation! Let’s raise AI literacy without scaring people off with overly complicated terminology while preserving technical accuracy!
Reposted by Elisa Kreiss
The EPFL NLP lab is looking to hire a postdoctoral researcher on the topic of designing, training, and evaluating multilingual LLMs:
docs.google.com/document/d/1...
Come join our dynamic group in beautiful Lausanne!
docs.google.com/document/d/1...
Come join our dynamic group in beautiful Lausanne!
EPFL NLP Postdoctoral Scholar Posting - Swiss AI LLMs
The EPFL Natural Language Processing (NLP) lab is looking to hire a postdoctoral researcher candidate in the area of multilingual LLM design, training, and evaluation. This postdoctoral position is as...
docs.google.com
August 4, 2025 at 3:54 PM
The EPFL NLP lab is looking to hire a postdoctoral researcher on the topic of designing, training, and evaluating multilingual LLMs:
docs.google.com/document/d/1...
Come join our dynamic group in beautiful Lausanne!
docs.google.com/document/d/1...
Come join our dynamic group in beautiful Lausanne!
Reposted by Elisa Kreiss
Neat year #NLP conferences:
📍 #EACL2026: 24–29 March 🇲🇦 Rabat (ARR deadline: 6 Oct)
📍 #LREC2026: 11–16 May 🇪🇸 Palma de Mallorca (deadline: 17 Oct)
📍 #ACL2026: 2–7 July 🇺🇸 San Diego (ARR deadline: 6 Jan)
📍 #COLING2027: 9–14 May 2027 🇲🇴 Macao
📍 #EACL2026: 24–29 March 🇲🇦 Rabat (ARR deadline: 6 Oct)
📍 #LREC2026: 11–16 May 🇪🇸 Palma de Mallorca (deadline: 17 Oct)
📍 #ACL2026: 2–7 July 🇺🇸 San Diego (ARR deadline: 6 Jan)
📍 #COLING2027: 9–14 May 2027 🇲🇴 Macao
July 31, 2025 at 9:20 AM
Neat year #NLP conferences:
📍 #EACL2026: 24–29 March 🇲🇦 Rabat (ARR deadline: 6 Oct)
📍 #LREC2026: 11–16 May 🇪🇸 Palma de Mallorca (deadline: 17 Oct)
📍 #ACL2026: 2–7 July 🇺🇸 San Diego (ARR deadline: 6 Jan)
📍 #COLING2027: 9–14 May 2027 🇲🇴 Macao
📍 #EACL2026: 24–29 March 🇲🇦 Rabat (ARR deadline: 6 Oct)
📍 #LREC2026: 11–16 May 🇪🇸 Palma de Mallorca (deadline: 17 Oct)
📍 #ACL2026: 2–7 July 🇺🇸 San Diego (ARR deadline: 6 Jan)
📍 #COLING2027: 9–14 May 2027 🇲🇴 Macao
Reposted by Elisa Kreiss
Only 2 out of 120 papers in my NeurIPS SAC batch have all reviewer scores ≥4! Don't despair with the low scores and focus on writing a clear and concise rebuttal! Good luck!
July 25, 2025 at 1:28 PM
Only 2 out of 120 papers in my NeurIPS SAC batch have all reviewer scores ≥4! Don't despair with the low scores and focus on writing a clear and concise rebuttal! Good luck!
Reposted by Elisa Kreiss
Woke up to a pleasant surprise! Guardian wrote a nice article covering our Binary climate data study!
TLDR: “Before and after” climate data can help counter the boiling frog effect
www.theguardian.com/news/2025/ju...
TLDR: “Before and after” climate data can help counter the boiling frog effect
www.theguardian.com/news/2025/ju...
‘Boiling frog’ effect makes people oblivious to threat of climate crisis, shows study
Research shows people’s response to binary data could drive more effective ways of communicating gravity of crisis
www.theguardian.com
July 24, 2025 at 11:13 PM
Woke up to a pleasant surprise! Guardian wrote a nice article covering our Binary climate data study!
TLDR: “Before and after” climate data can help counter the boiling frog effect
www.theguardian.com/news/2025/ju...
TLDR: “Before and after” climate data can help counter the boiling frog effect
www.theguardian.com/news/2025/ju...
Reposted by Elisa Kreiss
Headed to #CogSci2025 next week!
Interested in computational cognitive science applied to climate change and real-world policy? Come find me!
My lab at UCLA is recruiting 1–2 fully funded PhD students.
We work on:
• decision-making
• climate perception
• human–AI collaboration for policy design
Interested in computational cognitive science applied to climate change and real-world policy? Come find me!
My lab at UCLA is recruiting 1–2 fully funded PhD students.
We work on:
• decision-making
• climate perception
• human–AI collaboration for policy design
July 23, 2025 at 6:02 PM
Headed to #CogSci2025 next week!
Interested in computational cognitive science applied to climate change and real-world policy? Come find me!
My lab at UCLA is recruiting 1–2 fully funded PhD students.
We work on:
• decision-making
• climate perception
• human–AI collaboration for policy design
Interested in computational cognitive science applied to climate change and real-world policy? Come find me!
My lab at UCLA is recruiting 1–2 fully funded PhD students.
We work on:
• decision-making
• climate perception
• human–AI collaboration for policy design
Reposted by Elisa Kreiss
I'm sadly not at #IC2S2 😭, but I will be at #ACL2025 in Vienna ☕️ next week!!
Please spread the word that I'm recruiting prospective PhD students: lucy3.notion.site/for-prospect...
Please spread the word that I'm recruiting prospective PhD students: lucy3.notion.site/for-prospect...
For Prospective PhD Students
I’m recruiting PhD students who will begin their degree in Fall 2026! I am an incoming assistant professor at Wisconsin-Madison’s Computer Sciences department, and my research focuses on natural langu...
lucy3.notion.site
July 22, 2025 at 1:09 AM
I'm sadly not at #IC2S2 😭, but I will be at #ACL2025 in Vienna ☕️ next week!!
Please spread the word that I'm recruiting prospective PhD students: lucy3.notion.site/for-prospect...
Please spread the word that I'm recruiting prospective PhD students: lucy3.notion.site/for-prospect...