Karolina Stańczak
@karstanczak.bsky.social
#NLP Postdoc at Mila - Quebec AI Institute and McGill University | Former PhD @ University of Copenhagen (CopeNLU)
🌐 karstanczak.github.io
🌐 karstanczak.github.io
Reposted by Karolina Stańczak
Thank you to everyone who joined the GeBNLP Workshop at #ACL2025! ✨
To help us improve future events, please share your feedback in our anonymous 5-minute survey. Your perspective is needed!
📝 Survey Link: forms.gle/mXtZ4mWUGSBN...
#GeBNLP #NLP
To help us improve future events, please share your feedback in our anonymous 5-minute survey. Your perspective is needed!
📝 Survey Link: forms.gle/mXtZ4mWUGSBN...
#GeBNLP #NLP
Feedback form for the Workshop on Gender Bias in NLP (GeBNLP) @ ACL
Thank you for participating in the 6th Workshop on Gender Bias in NLP! Your feedback is incredibly valuable and will help us improve future events. This anonymous form should take less than 5 minutes ...
forms.gle
August 11, 2025 at 11:07 AM
Thank you to everyone who joined the GeBNLP Workshop at #ACL2025! ✨
To help us improve future events, please share your feedback in our anonymous 5-minute survey. Your perspective is needed!
📝 Survey Link: forms.gle/mXtZ4mWUGSBN...
#GeBNLP #NLP
To help us improve future events, please share your feedback in our anonymous 5-minute survey. Your perspective is needed!
📝 Survey Link: forms.gle/mXtZ4mWUGSBN...
#GeBNLP #NLP
Reposted by Karolina Stańczak
We are thrilled to announce our keynote speakers for the 6th Workshop on Gender Bias in NLP @ #ACL2025!
Please join us in welcoming:
🔹Anne Lauscher @a-lauscher.bsky.social
🔹Maarten Sap @maartensap.bsky.social
Full details: gebnlp-workshop.github.io/keynotes.html
See you on August 1! ☀️
#NLP #GeBNLP
Please join us in welcoming:
🔹Anne Lauscher @a-lauscher.bsky.social
🔹Maarten Sap @maartensap.bsky.social
Full details: gebnlp-workshop.github.io/keynotes.html
See you on August 1! ☀️
#NLP #GeBNLP
July 16, 2025 at 1:36 PM
We are thrilled to announce our keynote speakers for the 6th Workshop on Gender Bias in NLP @ #ACL2025!
Please join us in welcoming:
🔹Anne Lauscher @a-lauscher.bsky.social
🔹Maarten Sap @maartensap.bsky.social
Full details: gebnlp-workshop.github.io/keynotes.html
See you on August 1! ☀️
#NLP #GeBNLP
Please join us in welcoming:
🔹Anne Lauscher @a-lauscher.bsky.social
🔹Maarten Sap @maartensap.bsky.social
Full details: gebnlp-workshop.github.io/keynotes.html
See you on August 1! ☀️
#NLP #GeBNLP
Reposted by Karolina Stańczak
Our VLMs4All workshop is taking place today!
📅 on Thursday, June 12
⏲️ from 9AM CDT
🏛️in Room 104E
Join us today at @cvprconference.bsky.social for amazing speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware!
#CVPR2025
📅 on Thursday, June 12
⏲️ from 9AM CDT
🏛️in Room 104E
Join us today at @cvprconference.bsky.social for amazing speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware!
#CVPR2025
🗓️ Save the date! It's official: The VLMs4All Workshop at #CVPR2025 will be held on June 12th!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
June 12, 2025 at 11:22 AM
Our VLMs4All workshop is taking place today!
📅 on Thursday, June 12
⏲️ from 9AM CDT
🏛️in Room 104E
Join us today at @cvprconference.bsky.social for amazing speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware!
#CVPR2025
📅 on Thursday, June 12
⏲️ from 9AM CDT
🏛️in Room 104E
Join us today at @cvprconference.bsky.social for amazing speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware!
#CVPR2025
Reposted by Karolina Stańczak
Do LLMs hallucinate randomly? Not quite.
Our #ACL2025 (Main) paper shows that hallucinations under irrelevant contexts follow a systematic failure mode — revealing how LLMs generalize using abstract classes + context cues, albeit unreliably.
📎 Paper: arxiv.org/abs/2505.22630 1/n
Our #ACL2025 (Main) paper shows that hallucinations under irrelevant contexts follow a systematic failure mode — revealing how LLMs generalize using abstract classes + context cues, albeit unreliably.
📎 Paper: arxiv.org/abs/2505.22630 1/n
June 6, 2025 at 6:10 PM
Do LLMs hallucinate randomly? Not quite.
Our #ACL2025 (Main) paper shows that hallucinations under irrelevant contexts follow a systematic failure mode — revealing how LLMs generalize using abstract classes + context cues, albeit unreliably.
📎 Paper: arxiv.org/abs/2505.22630 1/n
Our #ACL2025 (Main) paper shows that hallucinations under irrelevant contexts follow a systematic failure mode — revealing how LLMs generalize using abstract classes + context cues, albeit unreliably.
📎 Paper: arxiv.org/abs/2505.22630 1/n
Reposted by Karolina Stańczak
🗓️ Save the date! It's official: The VLMs4All Workshop at #CVPR2025 will be held on June 12th!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
June 6, 2025 at 9:19 AM
🗓️ Save the date! It's official: The VLMs4All Workshop at #CVPR2025 will be held on June 12th!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐
Check out the schedule below!
Reposted by Karolina Stańczak
🚨 Deadline Extension Alert for #VLMs4All Challenges! 🚨
We have extended the challenge submission deadline
🛠️ New challenge deadline: Apr 22
Show your stuff in the CulturalVQA and GlobalRG challenges!
👉 sites.google.com/view/vlms4al...
Spread the word and keep those submissions coming! 🌍✨
We have extended the challenge submission deadline
🛠️ New challenge deadline: Apr 22
Show your stuff in the CulturalVQA and GlobalRG challenges!
👉 sites.google.com/view/vlms4al...
Spread the word and keep those submissions coming! 🌍✨
April 17, 2025 at 1:58 PM
🚨 Deadline Extension Alert for #VLMs4All Challenges! 🚨
We have extended the challenge submission deadline
🛠️ New challenge deadline: Apr 22
Show your stuff in the CulturalVQA and GlobalRG challenges!
👉 sites.google.com/view/vlms4al...
Spread the word and keep those submissions coming! 🌍✨
We have extended the challenge submission deadline
🛠️ New challenge deadline: Apr 22
Show your stuff in the CulturalVQA and GlobalRG challenges!
👉 sites.google.com/view/vlms4al...
Spread the word and keep those submissions coming! 🌍✨
Exciting release! AgentRewardBench offers that much-needed closer look at evaluating agent capabilities: automatic vs. human eval. Important findings here, especially on the popular LLM judges. Amazing work by @xhluca.bsky.social & team!
AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
We are releasing the first benchmark to evaluate how well automatic evaluators, such as LLM judges, can evaluate web agent trajectories.
We are releasing the first benchmark to evaluate how well automatic evaluators, such as LLM judges, can evaluate web agent trajectories.
April 15, 2025 at 7:11 PM
Exciting release! AgentRewardBench offers that much-needed closer look at evaluating agent capabilities: automatic vs. human eval. Important findings here, especially on the popular LLM judges. Amazing work by @xhluca.bsky.social & team!
Reposted by Karolina Stańczak
🔔 Reminder & Call for #VLMs4All @ #CVPR2025!
Help shape the future of culturally aware & geo-diverse VLMs:
⚔️ Challenges: Deadline: Apr 15 🔗https://sites.google.com/view/vlms4all/challenges
📄 Papers (4pg): Deadline: Apr 22 🔗https://sites.google.com/view/vlms4all/call-for-papers
Join us!
Help shape the future of culturally aware & geo-diverse VLMs:
⚔️ Challenges: Deadline: Apr 15 🔗https://sites.google.com/view/vlms4all/challenges
📄 Papers (4pg): Deadline: Apr 22 🔗https://sites.google.com/view/vlms4all/call-for-papers
Join us!
📢Excited to announce our upcoming workshop - Vision Language Models For All: Building Geo-Diverse and Culturally Aware Vision-Language Models (VLMs-4-All) @CVPR 2025!
🌐 sites.google.com/view/vlms4all
🌐 sites.google.com/view/vlms4all
April 9, 2025 at 11:20 AM
Reviewers needed! 📢 The 6th Workshop on Gender Bias in NLP at #ACL2025 (Vienna, Aug 1st) is looking for you! Sign up to review:
forms.gle/VkPU4vS4EacE... #NLP
forms.gle/VkPU4vS4EacE... #NLP
April 7, 2025 at 8:34 AM
Reviewers needed! 📢 The 6th Workshop on Gender Bias in NLP at #ACL2025 (Vienna, Aug 1st) is looking for you! Sign up to review:
forms.gle/VkPU4vS4EacE... #NLP
forms.gle/VkPU4vS4EacE... #NLP
Excited to be organizing the VLMs4All workshop at #CVPR2025! 🎉
The workshop features fantastic speakers, a short-paper track, and two challenges, including one based on CulturalVQA. Don’t miss it!
The workshop features fantastic speakers, a short-paper track, and two challenges, including one based on CulturalVQA. Don’t miss it!
March 14, 2025 at 5:21 PM
Excited to be organizing the VLMs4All workshop at #CVPR2025! 🎉
The workshop features fantastic speakers, a short-paper track, and two challenges, including one based on CulturalVQA. Don’t miss it!
The workshop features fantastic speakers, a short-paper track, and two challenges, including one based on CulturalVQA. Don’t miss it!
Reposted by Karolina Stańczak
6/ 🤝 Thanks to our steering committees and co-organizers for their hard work in making the VLMs4All Workshop possible!
@meharbhatia.bsky.social @rabiul.bsky.social @spandanagella.bsky.social @sivareddyg.bsky.social @svansteenkiste.bsky.social @karstanczak.bsky.social
@meharbhatia.bsky.social @rabiul.bsky.social @spandanagella.bsky.social @sivareddyg.bsky.social @svansteenkiste.bsky.social @karstanczak.bsky.social
March 14, 2025 at 3:55 PM
6/ 🤝 Thanks to our steering committees and co-organizers for their hard work in making the VLMs4All Workshop possible!
@meharbhatia.bsky.social @rabiul.bsky.social @spandanagella.bsky.social @sivareddyg.bsky.social @svansteenkiste.bsky.social @karstanczak.bsky.social
@meharbhatia.bsky.social @rabiul.bsky.social @spandanagella.bsky.social @sivareddyg.bsky.social @svansteenkiste.bsky.social @karstanczak.bsky.social
Reposted by Karolina Stańczak
Instruction-following retrievers can efficiently and accurately search for harmful and sensitive information on the internet! 🌐💣
Retrievers need to be aligned too! 🚨🚨🚨
Work done with the wonderful Nick and @sivareddyg.bsky.social
🔗 mcgill-nlp.github.io/malicious-ir/
Thread: 🧵👇
Retrievers need to be aligned too! 🚨🚨🚨
Work done with the wonderful Nick and @sivareddyg.bsky.social
🔗 mcgill-nlp.github.io/malicious-ir/
Thread: 🧵👇
Exploiting Instruction-Following Retrievers for Malicious Information Retrieval
Parishad BehnamGhader, Nicholas Meade, Siva Reddy
mcgill-nlp.github.io
March 12, 2025 at 4:15 PM
Instruction-following retrievers can efficiently and accurately search for harmful and sensitive information on the internet! 🌐💣
Retrievers need to be aligned too! 🚨🚨🚨
Work done with the wonderful Nick and @sivareddyg.bsky.social
🔗 mcgill-nlp.github.io/malicious-ir/
Thread: 🧵👇
Retrievers need to be aligned too! 🚨🚨🚨
Work done with the wonderful Nick and @sivareddyg.bsky.social
🔗 mcgill-nlp.github.io/malicious-ir/
Thread: 🧵👇
The potential for malicious misuse of LLM agents is a serious threat.
That's why we created SafeArena, a safety benchmark for web agents. See the thread and our paper for details: arxiv.org/abs/2503.04957 👇
That's why we created SafeArena, a safety benchmark for web agents. See the thread and our paper for details: arxiv.org/abs/2503.04957 👇
March 10, 2025 at 6:20 PM
The potential for malicious misuse of LLM agents is a serious threat.
That's why we created SafeArena, a safety benchmark for web agents. See the thread and our paper for details: arxiv.org/abs/2503.04957 👇
That's why we created SafeArena, a safety benchmark for web agents. See the thread and our paper for details: arxiv.org/abs/2503.04957 👇
Reposted by Karolina Stańczak
Llamas browsing the web look cute, but they are capable of causing a lot of harm!
Check out our new Web Agents ∩ Safety benchmark: SafeArena!
Paper: arxiv.org/abs/2503.04957
Check out our new Web Agents ∩ Safety benchmark: SafeArena!
Paper: arxiv.org/abs/2503.04957
March 10, 2025 at 5:51 PM
Llamas browsing the web look cute, but they are capable of causing a lot of harm!
Check out our new Web Agents ∩ Safety benchmark: SafeArena!
Paper: arxiv.org/abs/2503.04957
Check out our new Web Agents ∩ Safety benchmark: SafeArena!
Paper: arxiv.org/abs/2503.04957
📢New Paper Alert!🚀
Human alignment balances social expectations, economic incentives, and legal frameworks. What if LLM alignment worked the same way?🤔
Our latest work explores how social, economic, and contractual alignment can address incomplete contracts in LLM alignment🧵
Human alignment balances social expectations, economic incentives, and legal frameworks. What if LLM alignment worked the same way?🤔
Our latest work explores how social, economic, and contractual alignment can address incomplete contracts in LLM alignment🧵
March 4, 2025 at 4:08 PM
📢New Paper Alert!🚀
Human alignment balances social expectations, economic incentives, and legal frameworks. What if LLM alignment worked the same way?🤔
Our latest work explores how social, economic, and contractual alignment can address incomplete contracts in LLM alignment🧵
Human alignment balances social expectations, economic incentives, and legal frameworks. What if LLM alignment worked the same way?🤔
Our latest work explores how social, economic, and contractual alignment can address incomplete contracts in LLM alignment🧵
Reposted by Karolina Stańczak
The 6th edition of the Gender Bias in Natural Language Processing (GeBNLP) workshop is happening at #ACL2025 in Vienna!
📢 Check out our Call for Papers! Find all the details on our website: gebnlp-workshop.github.io
We look forward to your submissions!
📢 Check out our Call for Papers! Find all the details on our website: gebnlp-workshop.github.io
We look forward to your submissions!
February 28, 2025 at 6:04 PM
The 6th edition of the Gender Bias in Natural Language Processing (GeBNLP) workshop is happening at #ACL2025 in Vienna!
📢 Check out our Call for Papers! Find all the details on our website: gebnlp-workshop.github.io
We look forward to your submissions!
📢 Check out our Call for Papers! Find all the details on our website: gebnlp-workshop.github.io
We look forward to your submissions!
Reposted by Karolina Stańczak
Great news! We've extended the direct submission deadline to *April 18*, giving you more time to prepare your submissions 🚀
Check the new deadlines on our webpage: gebnlp-workshop.github.io/cfp.html
Check the new deadlines on our webpage: gebnlp-workshop.github.io/cfp.html
Call For Papers
The 6th Workshop on Gender Bias in Natural Language Processing at ACL 2025.
gebnlp-workshop.github.io
February 28, 2025 at 6:08 PM
Great news! We've extended the direct submission deadline to *April 18*, giving you more time to prepare your submissions 🚀
Check the new deadlines on our webpage: gebnlp-workshop.github.io/cfp.html
Check the new deadlines on our webpage: gebnlp-workshop.github.io/cfp.html
Reposted by Karolina Stańczak
Presenting ✨ 𝐂𝐇𝐀𝐒𝐄: 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐧𝐠 𝐜𝐡𝐚𝐥𝐥𝐞𝐧𝐠𝐢𝐧𝐠 𝐬𝐲𝐧𝐭𝐡𝐞𝐭𝐢𝐜 𝐝𝐚𝐭𝐚 𝐟𝐨𝐫 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧 ✨
Work w/ fantastic advisors Dima Bahdanau and @sivareddyg.bsky.social
Thread 🧵:
Work w/ fantastic advisors Dima Bahdanau and @sivareddyg.bsky.social
Thread 🧵:
February 21, 2025 at 4:29 PM
Presenting ✨ 𝐂𝐇𝐀𝐒𝐄: 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐧𝐠 𝐜𝐡𝐚𝐥𝐥𝐞𝐧𝐠𝐢𝐧𝐠 𝐬𝐲𝐧𝐭𝐡𝐞𝐭𝐢𝐜 𝐝𝐚𝐭𝐚 𝐟𝐨𝐫 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧 ✨
Work w/ fantastic advisors Dima Bahdanau and @sivareddyg.bsky.social
Thread 🧵:
Work w/ fantastic advisors Dima Bahdanau and @sivareddyg.bsky.social
Thread 🧵:
Reposted by Karolina Stańczak
⚫⚪ It's coming...SHADES. ⚪⚫
The first ever resource of multilingual, multicultural, and multigeographical stereotypes, built to support nuanced LLM evaluation and bias mitigation. We have been working on this around the world for almost **4 years** and I am thrilled to share it with you all soon.
The first ever resource of multilingual, multicultural, and multigeographical stereotypes, built to support nuanced LLM evaluation and bias mitigation. We have been working on this around the world for almost **4 years** and I am thrilled to share it with you all soon.
February 10, 2025 at 8:28 AM
⚫⚪ It's coming...SHADES. ⚪⚫
The first ever resource of multilingual, multicultural, and multigeographical stereotypes, built to support nuanced LLM evaluation and bias mitigation. We have been working on this around the world for almost **4 years** and I am thrilled to share it with you all soon.
The first ever resource of multilingual, multicultural, and multigeographical stereotypes, built to support nuanced LLM evaluation and bias mitigation. We have been working on this around the world for almost **4 years** and I am thrilled to share it with you all soon.
Excited to present today a poster at @OECD in Paris @IASEAIorg based on our upcoming paper "Societal Alignment Frameworks Can Improve LLM Alignment" (stay tuned for the pre-print soon!🎊). Today (Fri) at 1pm CET. Conference livestream: iaseai.org/conference
International Association for Safe & Ethical AI Conference — IASEAI 2025
The International Association for Safe and Ethical AI will host its inaugural conference (IASEAI ‘25) on Feb 6-7, 2025 at the OECD La Muette Headquarters and Conference Centre in Paris, ahead of the P...
iaseai.org
February 7, 2025 at 9:13 AM
Excited to present today a poster at @OECD in Paris @IASEAIorg based on our upcoming paper "Societal Alignment Frameworks Can Improve LLM Alignment" (stay tuned for the pre-print soon!🎊). Today (Fri) at 1pm CET. Conference livestream: iaseai.org/conference
Reposted by Karolina Stańczak
It turns out we had even more papers at EMNLP!
Let's complete the list with three more🧵
Let's complete the list with three more🧵
Our lab members recently presented 3 papers at @emnlpmeeting.bsky.social in Miami ☀️ 📜
From interpretability to bias/fairness and cultural understanding -> 🧵
From interpretability to bias/fairness and cultural understanding -> 🧵
November 24, 2024 at 2:17 AM
It turns out we had even more papers at EMNLP!
Let's complete the list with three more🧵
Let's complete the list with three more🧵
Reposted by Karolina Stańczak
What's the one advise you wish people would have told you before applying to a faculty position?
November 21, 2024 at 12:57 AM
What's the one advise you wish people would have told you before applying to a faculty position?
Reposted by Karolina Stańczak
CopeNLU @ #EMNLP2024 — hope you all enjoyed the conference as much as we did 😊🌴
See you again at #ACL2025NLP and #EMNLP2025!
#NLProc
@rnv.bsky.social, @dwright37.bsky.social, @zeerak.bsky.social
See you again at #ACL2025NLP and #EMNLP2025!
#NLProc
@rnv.bsky.social, @dwright37.bsky.social, @zeerak.bsky.social
November 17, 2024 at 1:59 PM
CopeNLU @ #EMNLP2024 — hope you all enjoyed the conference as much as we did 😊🌴
See you again at #ACL2025NLP and #EMNLP2025!
#NLProc
@rnv.bsky.social, @dwright37.bsky.social, @zeerak.bsky.social
See you again at #ACL2025NLP and #EMNLP2025!
#NLProc
@rnv.bsky.social, @dwright37.bsky.social, @zeerak.bsky.social