Yu Lu Liu
LightNews LightNews
liuyulu.bsky.social
Yu Lu Liu
@liuyulu.bsky.social
1K followers 890 following 34 posts
PhD student at Johns Hopkins University
Alumni from McGill University & MILA
Working on NLP Evaluation, Responsible AI, Human-AI interaction
she/her 🇨🇦
Posts Replies Media Videos
liuyulu.bsky.social
Human-centered Evalulation and Auditing of Language models (HEAL) workshop is back for #CHI2025, with this year's special theme: “Mind the Context”! Come join us on this bridge between #HCI and #NLProc!

Workshop submission deadline: Feb 17 AoE
More info at heal-workshop.github.io.
The image includes a shortened call for participation that reads: "We welcome participants who work on topics related to supporting human-centered evaluation and auditing of language models. Topics of interest include, but not limited to: - Empirical understanding of stakeholders' needs and goals of LLM evaluation and auditing - Human-centered evaluation and auditing methods for LLMs - Tools, processes, and guidelines for LLM evaluation and auditing - Discussion of regulatory measures and public policies for LLM auditing - Ethics in LLM evaluation and auditing Special Theme: Mind the Context. We invite authors to engage with specific contexts in LLM evaluation and auditing. This theme could involve various topics: the usage contexts of LLMs, the context of the evaluation/auditing itself, and more! The term ''context'' is purposefully left open for interpretation! The image also includes pictures of workshop organizers, who are: Yu Lu Liu, Wesley Hanwen Deng, Michelle S. Lam, Motahhare Eslami, Juho Kim, Q. Vera Liao, Wei Xu, Jekaterina Novikova, and Ziang Xiao.
December 16, 2024 at 10:07 PM
liuyulu.bsky.social
If you are at #EMNLP2024, don't miss the "Human-Centered Evaluation of Language Technologies" tutorial on Saturday 14:00-17:30! My awesome mentors will be teaching about this awesome topic ❤️
Promotional graphic of "Human-Centered Evaluation of Language Technologies" tutorial at EMNLP 2024, happening on Saturday November 16, 14:00-17:30. The instructors of this tutorial are Su Lin Blodgett, Jackie Chi Kit Cheung, Q. Vera Liao, and Ziang Xiao. Their profile pictures are shown at the bottom half of the graphic.
November 16, 2024 at 2:12 AM
liuyulu.bsky.social
🚚 Moving threads about my #nlp papers from Twitter to here 🚚

Do NLP benchmark measurements provide meaningful insights about the evaluated models? To help practitioners answer these questions, we introduce ECBD - a conceptual framework that formalizes the process of benchmark design 🧵.
Screenshot of the first page of the paper titled "ECBD: Evidence-Centered Benchmark Design for NLP", authored by Yu Lu Liu, Su Lin Blodgett, Jackie Chi Kit Cheung, Q. Vera Liao, Alexandra Olteanu, and Ziang Xiao.
November 12, 2024 at 9:52 PM
liuyulu.bsky.social
🚚 Moving threads about my #nlp papers from Twitter to here 🚚

How and when, and with which issues, does the text summarization community engage with responsible AI? 🤔 In this #EMNLP2023 paper, we examine reporting and research practices across 300 summarization papers published between 2020-2022 🧵
Screenshot of the first page of the paper titled "Responsible AI Considerations in Text Summarization Research: A Review of Current Practices", authored by Yu Lu Liu, Meng Cao, Su Lin Blodgett, Jackie Chi Kit Cheung, Alexandra Olteanu and Adam Trischler.
November 12, 2024 at 9:46 PM