Deb Raji
@rajiinio.bsky.social
AI accountability, audits & eval. Keen on participation & practical outcomes. CS PhDing @UCBerkeley.
Started a thread in the other place and bringing it over here - I really think we should be more vocal about the opportunities that lay at the intersection of these two options!
So I'm starting a live thread of new roles as I become aware of them - feel free to add / extend / share :
So I'm starting a live thread of new roles as I become aware of them - feel free to add / extend / share :
Life situations are bleak right now for a lot of people. In tech, the "Venn Diagram" of (1) positive work and (2) making enough money to support your family is increasingly non-overlapping. We all do what we can.
This image has been living in my mind rent-free for months.
This image has been living in my mind rent-free for months.
October 29, 2025 at 2:25 AM
Started a thread in the other place and bringing it over here - I really think we should be more vocal about the opportunities that lay at the intersection of these two options!
So I'm starting a live thread of new roles as I become aware of them - feel free to add / extend / share :
So I'm starting a live thread of new roles as I become aware of them - feel free to add / extend / share :
I feel like I have a conversation every other day with someone going through this exact crisis.
We need better options for those aiming to do good work.
We need better options for those aiming to do good work.
Life situations are bleak right now for a lot of people. In tech, the "Venn Diagram" of (1) positive work and (2) making enough money to support your family is increasingly non-overlapping. We all do what we can.
This image has been living in my mind rent-free for months.
This image has been living in my mind rent-free for months.
October 25, 2025 at 1:44 AM
I feel like I have a conversation every other day with someone going through this exact crisis.
We need better options for those aiming to do good work.
We need better options for those aiming to do good work.
There is so much about navigating the Internet in a low resourced language that makes one unnecessarily vulnerable to malicious actors. It's not just a quality of experience difference, but literally the soft belly through which misinformation spreaders attack.
Very excited for our upcoming #AIES paper Into the Void: Understanding Online Health Information in Low-Web Data Languages.
Link: arxiv.org/pdf/2509.20245
1/n
Link: arxiv.org/pdf/2509.20245
1/n
arxiv.org
September 25, 2025 at 10:21 PM
There is so much about navigating the Internet in a low resourced language that makes one unnecessarily vulnerable to malicious actors. It's not just a quality of experience difference, but literally the soft belly through which misinformation spreaders attack.
More of this kind of reporting, please!
September 12, 2025 at 5:11 PM
More of this kind of reporting, please!
Reposted by Deb Raji
So inspiring to see @karenhao.bsky.social in conversation with @rajiinio.bsky.social at the AI and Society event @ Berkeley. We need more formats like this in the Bay Area! (and beyond)
September 12, 2025 at 1:49 AM
So inspiring to see @karenhao.bsky.social in conversation with @rajiinio.bsky.social at the AI and Society event @ Berkeley. We need more formats like this in the Bay Area! (and beyond)
Reposted by Deb Raji
I’m excited to announce that my new book, _The Irrational Decision_, is now available for pre-order from Princeton University Press.
The Irrational Decision
How the computer revolution shaped our conception of rationality—and why human problems require solutions rooted in human intuition, morality, and judgment
press.princeton.edu
August 4, 2025 at 2:31 PM
I’m excited to announce that my new book, _The Irrational Decision_, is now available for pre-order from Princeton University Press.
Reposted by Deb Raji
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling by @victorojewale.bsky.social @rbsteed.com @briana-v.bsky.social @abeba.bsky.social @rajiinio.bsky.social compares the landscape of AI audit tools (tools.auditing-ai.com) to the actual needs of AI auditors.
July 24, 2025 at 7:53 PM
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling by @victorojewale.bsky.social @rbsteed.com @briana-v.bsky.social @abeba.bsky.social @rajiinio.bsky.social compares the landscape of AI audit tools (tools.auditing-ai.com) to the actual needs of AI auditors.
Emma has such good research taste :)
Given the sheer scale of these events, its really helpful to see what caught people's eye at these conferences...
Given the sheer scale of these events, its really helpful to see what caught people's eye at these conferences...
After having such a great time at #CHI2025 and #FAccT2025, I wanted to share some of my favorite recent papers here!
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
July 26, 2025 at 2:52 AM
Emma has such good research taste :)
Given the sheer scale of these events, its really helpful to see what caught people's eye at these conferences...
Given the sheer scale of these events, its really helpful to see what caught people's eye at these conferences...
Reposted by Deb Raji
After having such a great time at #CHI2025 and #FAccT2025, I wanted to share some of my favorite recent papers here!
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
July 14, 2025 at 5:03 PM
After having such a great time at #CHI2025 and #FAccT2025, I wanted to share some of my favorite recent papers here!
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!!
🧵⬇️:
Was beyond disappointed to see this in the AI Action Plan. Messing with the NIST RMF (which many private & public institutions currently rely on) feels like a cheap shot
July 24, 2025 at 2:25 PM
Was beyond disappointed to see this in the AI Action Plan. Messing with the NIST RMF (which many private & public institutions currently rely on) feels like a cheap shot
The way this was predictable from the start...
July 24, 2025 at 1:33 PM
The way this was predictable from the start...
This group (+ @leonyin.org ) makes this team like the Avengers of data journalists lol
Congrats to Bloomberg!
Congrats to Bloomberg!
Friday was my last day at WIRED. Today I started a new job at Bloomberg on a dream desk with @suryamattu.com and @jeffykao.bsky.social.
Got a tip? A dataset? Something we should look at? Find me on Signal at dmehro.89
In no particular order, here’s some stuff I’d like to continue to dig in to:
Got a tip? A dataset? Something we should look at? Find me on Signal at dmehro.89
In no particular order, here’s some stuff I’d like to continue to dig in to:
July 22, 2025 at 7:35 PM
This group (+ @leonyin.org ) makes this team like the Avengers of data journalists lol
Congrats to Bloomberg!
Congrats to Bloomberg!
Reposted by Deb Raji
The genius of the Wired people, as I see it from outside, is that they very quickly saw how a specific model of _tech_ reporting could be much more easily adapted into a closely related model of _political_ reporting, in a world where actual and organizational technology is urgently relevant.
July 15, 2025 at 10:02 PM
The genius of the Wired people, as I see it from outside, is that they very quickly saw how a specific model of _tech_ reporting could be much more easily adapted into a closely related model of _political_ reporting, in a world where actual and organizational technology is urgently relevant.
After my participation in the AI Senate forum, Andreesen went out of his way to find me on X and block me (I had never interacted w him).
Just a terrifyingly hateful person. I remain deeply unsettled the more I learn about how deep his prejudice actually goes.
Just a terrifyingly hateful person. I remain deeply unsettled the more I learn about how deep his prejudice actually goes.
New from me. Hope you’ll give it a read www.washingtonpost.com/technology/2...
Tech billionaire Trump adviser Marc Andreesen says universities will ‘pay the price’ for DEI
Tech investor and Trump adviser Marc Andreessen in a private group chat attacked colleges for promoting diversity, saying they had discriminated against “native born kids.”
www.washingtonpost.com
July 13, 2025 at 1:31 PM
After my participation in the AI Senate forum, Andreesen went out of his way to find me on X and block me (I had never interacted w him).
Just a terrifyingly hateful person. I remain deeply unsettled the more I learn about how deep his prejudice actually goes.
Just a terrifyingly hateful person. I remain deeply unsettled the more I learn about how deep his prejudice actually goes.
The distinction between this situation & the 2016 Tay twitter chatbot fiasco by Microsoft feels like a sign of the times - now, it's the companies actively trying to steer the chatbot towards extremist views rather than the interactions of a malicious public pushing the chatbot in that direction...
the 🐐 @matteowong.bsky.social and i tried to explain some of technical reasons for why grok went nazi as well as some of the less technical ones (prompting Grok to use X posts as a primary source and rhetorical inspiration). It's all quite awful and illuminating www.theatlantic.com/technology/a...
July 9, 2025 at 5:36 PM
The distinction between this situation & the 2016 Tay twitter chatbot fiasco by Microsoft feels like a sign of the times - now, it's the companies actively trying to steer the chatbot towards extremist views rather than the interactions of a malicious public pushing the chatbot in that direction...
One of the first things I noticed looking through SearchArena logs was the very stark differences between queries for search LLMs (eg. Perplexity AI, etc) and regular search engines.
It really is quite remarkable how different people's expectations are!
It really is quite remarkable how different people's expectations are!
An example of the type of search (would require reading multiple sites, balancing multiple constraints) where o3/Gemini 2.5 Pro has completely replaced Google for me.
July 6, 2025 at 12:46 PM
One of the first things I noticed looking through SearchArena logs was the very stark differences between queries for search LLMs (eg. Perplexity AI, etc) and regular search engines.
It really is quite remarkable how different people's expectations are!
It really is quite remarkable how different people's expectations are!
Reposted by Deb Raji
individual reporting for post-deployment evals — a little manifesto (& new preprints!)
tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.
tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.
July 1, 2025 at 11:38 PM
individual reporting for post-deployment evals — a little manifesto (& new preprints!)
tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.
tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.
Reposted by Deb Raji
In a stunning reversal, the Senate voted 99-1 this morning to strip from Trump's big bill a 10-year moratorium on state-level AI regulations.
Gift link to my story on how it happened and who's celebrating: wapo.st/3TOyiaG
Gift link to my story on how it happened and who's celebrating: wapo.st/3TOyiaG
In dramatic reversal, Senate votes to kill AI-law moratorium
A GOP-led bid to stop states from regulating AI collapsed after a deal to save it fell through.
www.washingtonpost.com
July 1, 2025 at 1:56 PM
In a stunning reversal, the Senate voted 99-1 this morning to strip from Trump's big bill a 10-year moratorium on state-level AI regulations.
Gift link to my story on how it happened and who's celebrating: wapo.st/3TOyiaG
Gift link to my story on how it happened and who's celebrating: wapo.st/3TOyiaG
July 1, 2025 at 3:19 PM
Reposted by Deb Raji
I am so excited to be in 🇬🇷Athens🇬🇷 to present "A Framework for Auditing Chatbots for Dialect-Based Quality-of-Service Harms" by me, @kizilcec.bsky.social, and @allisonkoe.bsky.social, at #FAccT2025!!
🔗: arxiv.org/pdf/2506.04419
🔗: arxiv.org/pdf/2506.04419
June 23, 2025 at 2:45 PM
I am so excited to be in 🇬🇷Athens🇬🇷 to present "A Framework for Auditing Chatbots for Dialect-Based Quality-of-Service Harms" by me, @kizilcec.bsky.social, and @allisonkoe.bsky.social, at #FAccT2025!!
🔗: arxiv.org/pdf/2506.04419
🔗: arxiv.org/pdf/2506.04419
Reposted by Deb Raji
Your #FAccT2025 General Chairs @sciorestis.bsky.social, @metaxa.net, and I, reporting from the venue.
We're looking forward to welcoming you to the Athens Conservatoire or online!
We're looking forward to welcoming you to the Athens Conservatoire or online!
June 22, 2025 at 7:09 PM
Your #FAccT2025 General Chairs @sciorestis.bsky.social, @metaxa.net, and I, reporting from the venue.
We're looking forward to welcoming you to the Athens Conservatoire or online!
We're looking forward to welcoming you to the Athens Conservatoire or online!
Reposted by Deb Raji
🏆 Announcing the #FAccT2025 best paper awards! 🏆
Congratulations to all the authors of the three best papers and three honorable mention papers.
Be sure to check out their presentations at the conference next week!
facct-blog.github.io/2025-06-20/b...
Congratulations to all the authors of the three best papers and three honorable mention papers.
Be sure to check out their presentations at the conference next week!
facct-blog.github.io/2025-06-20/b...
Announcing Best Paper Awards
The Best Paper Award Committee was chaired this year by Alex Chouldechova and included six Area Chairs. The committee selected three papers for the Best Paper Award and recognized three additional pap...
facct-blog.github.io
June 20, 2025 at 9:14 PM
🏆 Announcing the #FAccT2025 best paper awards! 🏆
Congratulations to all the authors of the three best papers and three honorable mention papers.
Be sure to check out their presentations at the conference next week!
facct-blog.github.io/2025-06-20/b...
Congratulations to all the authors of the three best papers and three honorable mention papers.
Be sure to check out their presentations at the conference next week!
facct-blog.github.io/2025-06-20/b...
Reposted by Deb Raji
New paper out today, accepted at #FAccT2025, led by Jake Stein and me: "Not Even Nice Work If You Can Get It; A Longitudinal Study of Uber's Algorithmic Pay and Pricing" arxiv.org/abs/2506.15278
Over the last 3 years, we've been working with @workerinfox.bsky.social to audit Uber's algorithms. 1/
Over the last 3 years, we've been working with @workerinfox.bsky.social to audit Uber's algorithms. 1/
Not Even Nice Work If You Can Get It; A Longitudinal Study of Uber's Algorithmic Pay and Pricing
Ride-sharing platforms like Uber market themselves as enabling `flexibility' for their workforce, meaning that drivers are expected to anticipate when and where the algorithm will allocate them jobs, ...
arxiv.org
June 19, 2025 at 8:03 AM
New paper out today, accepted at #FAccT2025, led by Jake Stein and me: "Not Even Nice Work If You Can Get It; A Longitudinal Study of Uber's Algorithmic Pay and Pricing" arxiv.org/abs/2506.15278
Over the last 3 years, we've been working with @workerinfox.bsky.social to audit Uber's algorithms. 1/
Over the last 3 years, we've been working with @workerinfox.bsky.social to audit Uber's algorithms. 1/
Said this in the other place and perhaps worth repeating here: this is just such a careful and almost brutally honest analysis of the ways that our efforts to "fix" things at the technical artifact level can fundamentally fall short of making meaningful system wide impact. Lots to learn here.
For almost a decade, there's been a lot of (justified) hand-wringing and paper-writing about fairness issues in AI. This case gets to the heart of a very important question - how much of that work has materially improved the lives of real people?
Grateful for this careful & honest investigation.
Grateful for this careful & honest investigation.
New from me @gabrielgeiger.bsky.social + Justin-Casimir Braun:
Amsterdam believed that it could build a #predictiveAI for welfare fraud that would ALSO be fair, unbiased, & a positive case study for #ResponsibleAI. It didn't work.
Our deep dive why: www.technologyreview.com/2025/06/11/1...
Amsterdam believed that it could build a #predictiveAI for welfare fraud that would ALSO be fair, unbiased, & a positive case study for #ResponsibleAI. It didn't work.
Our deep dive why: www.technologyreview.com/2025/06/11/1...
June 12, 2025 at 2:42 AM
Said this in the other place and perhaps worth repeating here: this is just such a careful and almost brutally honest analysis of the ways that our efforts to "fix" things at the technical artifact level can fundamentally fall short of making meaningful system wide impact. Lots to learn here.
For almost a decade, there's been a lot of (justified) hand-wringing and paper-writing about fairness issues in AI. This case gets to the heart of a very important question - how much of that work has materially improved the lives of real people?
Grateful for this careful & honest investigation.
Grateful for this careful & honest investigation.
New from me @gabrielgeiger.bsky.social + Justin-Casimir Braun:
Amsterdam believed that it could build a #predictiveAI for welfare fraud that would ALSO be fair, unbiased, & a positive case study for #ResponsibleAI. It didn't work.
Our deep dive why: www.technologyreview.com/2025/06/11/1...
Amsterdam believed that it could build a #predictiveAI for welfare fraud that would ALSO be fair, unbiased, & a positive case study for #ResponsibleAI. It didn't work.
Our deep dive why: www.technologyreview.com/2025/06/11/1...
Inside Amsterdam’s high-stakes experiment to create fair welfare AI
The Dutch city thought it could break a decade-long trend of implementing discriminatory algorithms. Its failure raises the question: can these programs ever be fair?
www.technologyreview.com
June 11, 2025 at 10:58 PM
For almost a decade, there's been a lot of (justified) hand-wringing and paper-writing about fairness issues in AI. This case gets to the heart of a very important question - how much of that work has materially improved the lives of real people?
Grateful for this careful & honest investigation.
Grateful for this careful & honest investigation.