Ken Holstein
@kenholstein.bsky.social
HCI Prof at CMU HCII: thecoalalab.com
Research on:
- technologies to augment human thinking and learning
- participatory & responsible AI
- human-AI interaction
Research on:
- technologies to augment human thinking and learning
- participatory & responsible AI
- human-AI interaction
Submit to the 6th Human-Centered Explainable AI (HCXAI) workshop at CHI 2026 in Barcelona!
🗓️ Deadline: Feb 19, 2026
📝 2-5 page single column papers (excluding refs)
🌐 hcxai.jimdosite.com
🗓️ Deadline: Feb 19, 2026
📝 2-5 page single column papers (excluding refs)
🌐 hcxai.jimdosite.com
We're calling for papers, prototypes, and provocations that:
🔥 Challenges assumptions about what constitutes explainability
🚨 Exposes limits, failures, and unintended consequences
🌍 Bridges disciplines: HCI, AI, social science, law, design, domain expertise
7/n
🔥 Challenges assumptions about what constitutes explainability
🚨 Exposes limits, failures, and unintended consequences
🌍 Bridges disciplines: HCI, AI, social science, law, design, domain expertise
7/n
Home | HCXAI
ACM CHI 2026 Workshop on Human-Centered Explainable AI (HCXAI). April 13-16, 2025 (Barcelona Spain). This is the flagship workshop on HCXAI and one of the most well-attended and longest running worksh...
hcxai.jimdosite.com
January 12, 2026 at 9:25 PM
Submit to the 6th Human-Centered Explainable AI (HCXAI) workshop at CHI 2026 in Barcelona!
🗓️ Deadline: Feb 19, 2026
📝 2-5 page single column papers (excluding refs)
🌐 hcxai.jimdosite.com
🗓️ Deadline: Feb 19, 2026
📝 2-5 page single column papers (excluding refs)
🌐 hcxai.jimdosite.com
The Tools for Thought workshop at #CHI2026 is now accepting submissions! (due Feb 12, 2026 AoE)
We invite work that explores how to effectively design, evaluate, or apply *AI-based tools that augment and protect human cognition*.
For more, see: ai-tools-for-thought.github.io/workshop/
We invite work that explores how to effectively design, evaluate, or apply *AI-based tools that augment and protect human cognition*.
For more, see: ai-tools-for-thought.github.io/workshop/
January 1, 2026 at 8:01 PM
The Tools for Thought workshop at #CHI2026 is now accepting submissions! (due Feb 12, 2026 AoE)
We invite work that explores how to effectively design, evaluate, or apply *AI-based tools that augment and protect human cognition*.
For more, see: ai-tools-for-thought.github.io/workshop/
We invite work that explores how to effectively design, evaluate, or apply *AI-based tools that augment and protect human cognition*.
For more, see: ai-tools-for-thought.github.io/workshop/
Reposted by Ken Holstein
In a new blog post, I contrast two flavors of empiricism: the one practiced in the social sciences and the one practiced in ML/CS.
I argue that we need both, given that CS is increasingly about "claims," and not just constructing artifacts.
doomscrollingbabel.manoel.xyz/p/the-empiri...
I argue that we need both, given that CS is increasingly about "claims," and not just constructing artifacts.
doomscrollingbabel.manoel.xyz/p/the-empiri...
December 26, 2025 at 12:40 PM
In a new blog post, I contrast two flavors of empiricism: the one practiced in the social sciences and the one practiced in ML/CS.
I argue that we need both, given that CS is increasingly about "claims," and not just constructing artifacts.
doomscrollingbabel.manoel.xyz/p/the-empiri...
I argue that we need both, given that CS is increasingly about "claims," and not just constructing artifacts.
doomscrollingbabel.manoel.xyz/p/the-empiri...
Reposted by Ken Holstein
In case you missed it in the flurry of NeurIPS activity, @hannawallach.bsky.social and I recorded a (video) podcast on women in ML, friendship, research, and careers.
On my way to San Diego for #NeurIPS and the 20th anniversary of #WiML! To celebrate, @hannawallach.bsky.social and I recorded a podcast discussing WiML’s journey, our friendship and collaborations, research we're excited about, & advice we'd give our younger selves! www.microsoft.com/en-us/resear...
Ideas: Community building, machine learning, and the future of AI
As the Women in Machine Learning Workshop (WiML) marks its 20th annual gathering, cofounders, friends, and collaborators Jenn Wortman Vaughan and Hanna Wallach reflect on WiML’s evolution, navigating ...
www.microsoft.com
December 16, 2025 at 6:04 PM
In case you missed it in the flurry of NeurIPS activity, @hannawallach.bsky.social and I recorded a (video) podcast on women in ML, friendship, research, and careers.
Reposted by Ken Holstein
Spread the word! 📢 The FATE (Fairness, Accountability, Transparency, and Ethics) group at @msftresearch.bsky.social in NYC is hiring interns and postdocs to start in summer 2026! 🎉
Apply by *December 15* for full consideration.
Apply by *December 15* for full consideration.
November 20, 2025 at 8:11 PM
Spread the word! 📢 The FATE (Fairness, Accountability, Transparency, and Ethics) group at @msftresearch.bsky.social in NYC is hiring interns and postdocs to start in summer 2026! 🎉
Apply by *December 15* for full consideration.
Apply by *December 15* for full consideration.
Reposted by Ken Holstein
Can public involvement in AI evaluation improve the science? Or does it compromise quality, speed, cost?
In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI
www.pnas.org/doi/10.1073/...
In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI
www.pnas.org/doi/10.1073/...
How public involvement can improve the science of AI | PNAS
As AI systems from decision-making algorithms to generative AI are deployed more widely,
computer scientists and social scientists alike are being ...
www.pnas.org
November 17, 2025 at 12:47 PM
Can public involvement in AI evaluation improve the science? Or does it compromise quality, speed, cost?
In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI
www.pnas.org/doi/10.1073/...
In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI
www.pnas.org/doi/10.1073/...
Reposted by Ken Holstein
I am beyond trilled to present two 🏆 award-winning papers 🏆 @acm-cscw.bsky.social this year CSCW in beautiful Bergen, Norway!! Broadly, I'm excited to chat about responsible AI, AI auditing and red-teaming, and human-AI interaction. Say hi if we run into each other!
October 19, 2025 at 1:49 PM
I am beyond trilled to present two 🏆 award-winning papers 🏆 @acm-cscw.bsky.social this year CSCW in beautiful Bergen, Norway!! Broadly, I'm excited to chat about responsible AI, AI auditing and red-teaming, and human-AI interaction. Say hi if we run into each other!
Reposted by Ken Holstein
Inspired by a post by @bayesianboy.bsky.social , I wrote something on the differences between information and insight — and why understanding remains a very human act
The point is to understand
Machines can’t make sense of the world for us.
renderghost.leaflet.pub
October 16, 2025 at 10:46 AM
Inspired by a post by @bayesianboy.bsky.social , I wrote something on the differences between information and insight — and why understanding remains a very human act
Reposted by Ken Holstein
A subtle aspect of predictive modeling is target variable construction: the process of translating a latent, unobservable concept like "healthcare need" into a prediction target
But how does target variable construction unfold in practice, and how can we better support it going forward? #CSCW2025 🧵
But how does target variable construction unfold in practice, and how can we better support it going forward? #CSCW2025 🧵
October 14, 2025 at 2:54 PM
A subtle aspect of predictive modeling is target variable construction: the process of translating a latent, unobservable concept like "healthcare need" into a prediction target
But how does target variable construction unfold in practice, and how can we better support it going forward? #CSCW2025 🧵
But how does target variable construction unfold in practice, and how can we better support it going forward? #CSCW2025 🧵
Reposted by Ken Holstein
LLM safety work often reasons over high-level policies (be helpful & polite), but must tackle on-the-ground cases (unsolicited money advice when stocks are mentioned). This can feel like driving on an unfamiliar road guided by a generic driver’s manual instead of a map. We introduce: Policy Maps 🗺️
September 29, 2025 at 3:54 PM
LLM safety work often reasons over high-level policies (be helpful & polite), but must tackle on-the-ground cases (unsolicited money advice when stocks are mentioned). This can feel like driving on an unfamiliar road guided by a generic driver’s manual instead of a map. We introduce: Policy Maps 🗺️
Reposted by Ken Holstein
There is a lot of talk and effort to figure out how genAI is different (I am also guilty of this!) -- the reality is that genAI is not that different and genAI is not that new either; it was hard to evaluate in the past, and it is still as hard to evaluate now #facct2025
June 23, 2025 at 7:17 AM
There is a lot of talk and effort to figure out how genAI is different (I am also guilty of this!) -- the reality is that genAI is not that different and genAI is not that new either; it was hard to evaluate in the past, and it is still as hard to evaluate now #facct2025
Reposted by Ken Holstein
Check out the camera-ready version of our ICML position paper ("Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge") to learn more!!! arxiv.org/abs/2502.00561
(6/6)
(6/6)
Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge
The measurement tasks involved in evaluating generative AI (GenAI) systems lack sufficient scientific rigor, leading to what has been described as "a tangle of sloppy tests [and] apples-to-oranges com...
arxiv.org
June 15, 2025 at 12:20 AM
Check out the camera-ready version of our ICML position paper ("Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge") to learn more!!! arxiv.org/abs/2502.00561
(6/6)
(6/6)
Reposted by Ken Holstein
Somewhat oddly, the Trump regime's initial moves to cut science funding went very broad. This is catalyzing solidarity & advocacy around the value of science (see comms featuring cancer cures & tech innovation). But their next move may be to try to drive a wedge b/w "good science" & "bad science".
May 15, 2025 at 3:02 PM
Somewhat oddly, the Trump regime's initial moves to cut science funding went very broad. This is catalyzing solidarity & advocacy around the value of science (see comms featuring cancer cures & tech innovation). But their next move may be to try to drive a wedge b/w "good science" & "bad science".
Reposted by Ken Holstein
How's fascism going for you? medium.com/bits-and-beh...
How is fascism going for you? Here’s how it’s going for me.
A catalog of impacts thus far from this administration’s horrors.
medium.com
May 12, 2025 at 12:45 AM
How's fascism going for you? medium.com/bits-and-beh...
Reposted by Ken Holstein
Securing your phone before entering the USA. 🧵
At CDC we travel around the globe to confront health threats and have never worried about returning home. Yet more researchers, including US Citizens, are having their phones searched at Customs.
security.ucop.edu/resources/tr...
At CDC we travel around the globe to confront health threats and have never worried about returning home. Yet more researchers, including US Citizens, are having their phones searched at Customs.
security.ucop.edu/resources/tr...
Returning to the U.S.
security.ucop.edu
March 24, 2025 at 9:14 PM
Securing your phone before entering the USA. 🧵
At CDC we travel around the globe to confront health threats and have never worried about returning home. Yet more researchers, including US Citizens, are having their phones searched at Customs.
security.ucop.edu/resources/tr...
At CDC we travel around the globe to confront health threats and have never worried about returning home. Yet more researchers, including US Citizens, are having their phones searched at Customs.
security.ucop.edu/resources/tr...
Reposted by Ken Holstein
Unidentified men grabbing someone off the street and putting her in a car because she wrote an op-Ed. This as flatly authoritarian as anything we’ve seen in this country in a very long time.
Video of the international student at Tufts being arrested by "federal authorities" in Massachusetts has been released and it's terrifying.
They're not even uniformed officers. Just secret police thugs in hoodies and masks.
From WCVB: youtu.be/PuFIs7OkzYY
They're not even uniformed officers. Just secret police thugs in hoodies and masks.
From WCVB: youtu.be/PuFIs7OkzYY
March 26, 2025 at 5:41 PM
Unidentified men grabbing someone off the street and putting her in a car because she wrote an op-Ed. This as flatly authoritarian as anything we’ve seen in this country in a very long time.
Reposted by Ken Holstein
1. @alisongopnik.bsky.social, Cosma Shalizi, James Evans and myself have a new piece in Science on "AI" Large Models, pushing back against much of the collective wisdom about what they can and can't do. Official below, unpaywalled at henryfarrell.net/large-ai-mod... . So why this now?
Large AI models are cultural and social technologies
Implications draw on the history of transformative information systems from the past
www.science.org
March 14, 2025 at 12:57 PM
1. @alisongopnik.bsky.social, Cosma Shalizi, James Evans and myself have a new piece in Science on "AI" Large Models, pushing back against much of the collective wisdom about what they can and can't do. Official below, unpaywalled at henryfarrell.net/large-ai-mod... . So why this now?
Reposted by Ken Holstein
How can we help communities collaboratively shape policies that impact them?
In our #CHI2025 paper, we present PolicyCraft, a system that supports ✨collaborative policy design✨ through case-grounded deliberation.
(🧵/11)
In our #CHI2025 paper, we present PolicyCraft, a system that supports ✨collaborative policy design✨ through case-grounded deliberation.
(🧵/11)
March 10, 2025 at 1:50 PM
How can we help communities collaboratively shape policies that impact them?
In our #CHI2025 paper, we present PolicyCraft, a system that supports ✨collaborative policy design✨ through case-grounded deliberation.
(🧵/11)
In our #CHI2025 paper, we present PolicyCraft, a system that supports ✨collaborative policy design✨ through case-grounded deliberation.
(🧵/11)
Reposted by Ken Holstein
How can we better think and talk about human-like qualities attributed to language technologies like LLMs? In our #CHI2025 paper, we taxonomize how text outputs from cases of user interactions with language technologies can contribute to anthropomorphism. arxiv.org/abs/2502.09870 1/n
March 6, 2025 at 3:43 AM
How can we better think and talk about human-like qualities attributed to language technologies like LLMs? In our #CHI2025 paper, we taxonomize how text outputs from cases of user interactions with language technologies can contribute to anthropomorphism. arxiv.org/abs/2502.09870 1/n
Reposted by Ken Holstein
"18F works just how Musk + team pretend that they want gov't to work. But when his team found it, they destroyed it. 18F’s work is evidence that gov't works well, which undermines their msg that it doesn’t. 18F’s parent agency, the [GSA], turns a profit as an agency. So it has to be destroyed too."
Requiem for 18F
A small government unit did what DOGE is pretending to do
donmoynihan.substack.com
March 4, 2025 at 3:34 PM
"18F works just how Musk + team pretend that they want gov't to work. But when his team found it, they destroyed it. 18F’s work is evidence that gov't works well, which undermines their msg that it doesn’t. 18F’s parent agency, the [GSA], turns a profit as an agency. So it has to be destroyed too."
Reposted by Ken Holstein
#Pittsburgh friends, Join me on Friday #standupforscience2025. Our city will be devastated if our universities lose critical funding. Our universities are top 10 employers, the entire city’s economy is dependent on science funding. www.eventbrite.com/e/stand-up-f...
Stand Up for Science 2025 - Pittsburgh, PA
Stand up for science with us on March 7th, 2025, because science is for everyone! More info at www.standupforscience2025.org
www.eventbrite.com
March 3, 2025 at 1:39 AM
#Pittsburgh friends, Join me on Friday #standupforscience2025. Our city will be devastated if our universities lose critical funding. Our universities are top 10 employers, the entire city’s economy is dependent on science funding. www.eventbrite.com/e/stand-up-f...
Reposted by Ken Holstein
🏛️ How can we ensure that AI enhances, rather than harms, public services?
In our policy memo, published with the Federation of American Scientists (@scientistsorg.bsky.social), we provide recommendations for how the fed gov't could help state & local agencies make better AI procurement decisions.🧵
In our policy memo, published with the Federation of American Scientists (@scientistsorg.bsky.social), we provide recommendations for how the fed gov't could help state & local agencies make better AI procurement decisions.🧵
Expanding Local Government Capacity for AI Procurement and Use
As new waves of AI technologies continue to enter the public sector, touching a breadth of services critical to the welfare of the American people, this center of excellence will help maintain high st...
fas.org
February 26, 2025 at 7:58 PM
🏛️ How can we ensure that AI enhances, rather than harms, public services?
In our policy memo, published with the Federation of American Scientists (@scientistsorg.bsky.social), we provide recommendations for how the fed gov't could help state & local agencies make better AI procurement decisions.🧵
In our policy memo, published with the Federation of American Scientists (@scientistsorg.bsky.social), we provide recommendations for how the fed gov't could help state & local agencies make better AI procurement decisions.🧵
Reposted by Ken Holstein
Joseph Ura: “A president refusing to abide by the law or the Constitution and ignoring court orders to stop his illegitimate actions would be a constitutional crisis like a bank robbery is a cash flow crisis.” www.theatlantic.com/newsletters/...
‘Constitutional Crisis’ Is an Understatement
It’s the hottest, and most useless, buzz phrase of the moment.
www.theatlantic.com
February 23, 2025 at 12:01 AM
Joseph Ura: “A president refusing to abide by the law or the Constitution and ignoring court orders to stop his illegitimate actions would be a constitutional crisis like a bank robbery is a cash flow crisis.” www.theatlantic.com/newsletters/...
Reposted by Ken Holstein
Friendly reminder to get your free Covid tests before they throw them away.
Covidtests.gov
wapo.st/42VLGQh
Covidtests.gov
wapo.st/42VLGQh
U.S. weighs destroying $500 million in stockpiled covid tests
The government is reviewing proposals to shut down the program that ships free covid tests to American households and has been considering destroying 160 million tests.
wapo.st
February 18, 2025 at 9:36 PM
Friendly reminder to get your free Covid tests before they throw them away.
Covidtests.gov
wapo.st/42VLGQh
Covidtests.gov
wapo.st/42VLGQh
Reposted by Ken Holstein
for pity’s sake, I am BEGGING university leaders to stop framing this issue in terms of what this will cost the university. people dont care!
EXPLAIN WHAT THIS WILL COST THE PUBLIC: closed hospitals and clinics, skipped treatments, loss of access to experimental drugs, unemployment, recession
EXPLAIN WHAT THIS WILL COST THE PUBLIC: closed hospitals and clinics, skipped treatments, loss of access to experimental drugs, unemployment, recession
February 9, 2025 at 10:00 PM
for pity’s sake, I am BEGGING university leaders to stop framing this issue in terms of what this will cost the university. people dont care!
EXPLAIN WHAT THIS WILL COST THE PUBLIC: closed hospitals and clinics, skipped treatments, loss of access to experimental drugs, unemployment, recession
EXPLAIN WHAT THIS WILL COST THE PUBLIC: closed hospitals and clinics, skipped treatments, loss of access to experimental drugs, unemployment, recession