If you have any interest in the future of AI, please join us for another really insightful conversation with @alondra.bsky.social. She's brilliant but better yet, she's right!

AI as governance -- @himself.bsky.social on how AI reshapes markets, bureaucracy, democracy...and culture. Very happy ot see this getting the mainstream social science treatment.
www.annualreviews.org/content/jour... I can't believe I missed this paper coming out!

Feeling so excited + grateful to be representing this paper at #ICML! Please stop by to talk about how to do more valid measurement for evaling gen AI systems!

Work led by the incomparable @hannawallach.bsky.social and @azjacobs.bsky.social as a part of Microsoft’s AI and Society initiative!!

“If ___ ran a mini nuclear power plant” seems like a strong vibe for the day

As ever, Tressie McMillan Cottom has the most astute analysis of how to read Musk's behavior. www.nytimes.com/2025/02/12/o...

big day to submit an article on how "efficiency" is used to undermine legitimacy of the administrative state

www.nytimes.com/2025/02/11/u... (gift link)

"there's a lot of qualitative work that goes into designing quantitative metrics" -- @azjacobs.bsky.social

"how do we translate between benchmark performance and what it will really be like to use a model" -- Su Lin Blodgett

"Overall, the starting list constitutes at best a narrow coverage of the risks the technology is likely to pose, & at worst a (partial) red herring poised to direct significant risk mitigation efforts to building on inappropriate foundations." @yjernite.bsky.social et al on the AI Act Systemic Risks

Evaluating Generative AI Systems is a Social Science Measurement Challenge: arxiv.org/abs/2411.10939

TL;DR: The ML community would benefit from learning from and drawing on the social sciences when evaluating GenAI systems.

New paper on why machine "unlearning" is much harder than it seems is now up on arXiv: arxiv.org/abs/2412.06966 This was a huuuuuge cross-disciplinary effort led by @msftresearch.bsky.social FATE postdoc @grumpy-frog.bsky.social!!!

The AI Interdisciplinary Institute at the University of Maryland (AIM) is hiring

40 new faculty members

in all areas of AI, particularly:
- accessibility,
- sustainability,
- social justice, and
- learning;

building on computational, humanistic, or social scientific approaches to AI.

>

Working on #bias & #discrimination in #NLP? Passionate about integrating insights from different disciplines? And do you want to discuss current limitations of #LLM bias mitigation work? 🤖
👋Join the workshop New Perspectives on Bias and Discrimination in Language Technology 4&5 Nov in #Amsterdam!

Not enough people are worried about this

I'm excited to share that the journal version of our paper, "An archival perspective on pretraining data", is now available (open access) from Patterns!

This project was led by @madesai.bsky.social, along with Irene Pasquetto, @azjacobs.bsky.social, and myself

www.cell.com/patterns/ful...

1/n

New executive order just dropped, with lots of roles for sociotechnical work around AI with relatively fast turnaround… but also a bat flying around the White House logo because the executive order is also spooky 🦇🦇
www.whitehouse.gov/briefing-roo...

One of the many, many concepts we discuss in our upcoming report is Measurement Modeling as it relates to AI governance. Discussed this with @azjacobs.bsky.social earlier this year.

Spent the last week at #FAccT2023 - filled with some exciting work and exciting scholars on measurement, policy, social impacts emerging from ML. Happy to see this letter come out of it:
https://facctconference.org/2023/harm-policy.html

Felt cute, might delete later