Matthias Orlikowski
@morlikow.bsky.social
Computer Science PhD student at Bielefeld University -
NLProc and Computational Social Science -
Disagreement, Human Label Variation, Perspectives -
Website: https://orlikow.ski
NLProc and Computational Social Science -
Disagreement, Human Label Variation, Perspectives -
Website: https://orlikow.ski
Pinned
Matthias Orlikowski
@morlikow.bsky.social
· Jul 20
I will be at #acl2025 to present "Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions" ✨
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
Reposted by Matthias Orlikowski
Proud to present our #EMNLP2025 papers!
Catch our team across Main, Findings, Workshops & Demos 👇
Catch our team across Main, Findings, Workshops & Demos 👇
October 31, 2025 at 2:04 PM
Proud to present our #EMNLP2025 papers!
Catch our team across Main, Findings, Workshops & Demos 👇
Catch our team across Main, Findings, Workshops & Demos 👇
Reposted by Matthias Orlikowski
🚨 New main paper out at #EMNLP2025! 🚨
⚡ We show that personalization of content moderation models can be harmful and perpetuate hate speech, defeating the purpose of the system and hurting the community.
We argue that personalized moderation needs boundaries, and we show how to build them.
⚡ We show that personalization of content moderation models can be harmful and perpetuate hate speech, defeating the purpose of the system and hurting the community.
We argue that personalized moderation needs boundaries, and we show how to build them.
October 31, 2025 at 5:05 PM
🚨 New main paper out at #EMNLP2025! 🚨
⚡ We show that personalization of content moderation models can be harmful and perpetuate hate speech, defeating the purpose of the system and hurting the community.
We argue that personalized moderation needs boundaries, and we show how to build them.
⚡ We show that personalization of content moderation models can be harmful and perpetuate hate speech, defeating the purpose of the system and hurting the community.
We argue that personalized moderation needs boundaries, and we show how to build them.
Reposted by Matthias Orlikowski
There’s plenty of evidence for political bias in LLMs, but very few evals reflect realistic LLM use cases — which is where bias actually matters.
IssueBench, our attempt to fix this, is accepted at TACL, and I will be at #EMNLP2025 next week to talk about it!
New results 🧵
IssueBench, our attempt to fix this, is accepted at TACL, and I will be at #EMNLP2025 next week to talk about it!
New results 🧵
Are LLMs biased when they write about political issues?
We just released IssueBench – the largest, most realistic benchmark of its kind – to answer this question more robustly than ever before.
Long 🧵with spicy results 👇
We just released IssueBench – the largest, most realistic benchmark of its kind – to answer this question more robustly than ever before.
Long 🧵with spicy results 👇
October 29, 2025 at 4:12 PM
There’s plenty of evidence for political bias in LLMs, but very few evals reflect realistic LLM use cases — which is where bias actually matters.
IssueBench, our attempt to fix this, is accepted at TACL, and I will be at #EMNLP2025 next week to talk about it!
New results 🧵
IssueBench, our attempt to fix this, is accepted at TACL, and I will be at #EMNLP2025 next week to talk about it!
New results 🧵
Reposted by Matthias Orlikowski
My lab is looking for a Senior Scientist (= PostDoc with option of permanency)!
We are looking for someone interested in doing cutting-edge computational social science + helping us with data & software engineering 🤓.
See job ad for details jobs.uni-graz.at/en/jobs/7d14...
We are looking for someone interested in doing cutting-edge computational social science + helping us with data & software engineering 🤓.
See job ad for details jobs.uni-graz.at/en/jobs/7d14...
Universität Graz
jobs.uni-graz.at
October 28, 2025 at 7:02 AM
My lab is looking for a Senior Scientist (= PostDoc with option of permanency)!
We are looking for someone interested in doing cutting-edge computational social science + helping us with data & software engineering 🤓.
See job ad for details jobs.uni-graz.at/en/jobs/7d14...
We are looking for someone interested in doing cutting-edge computational social science + helping us with data & software engineering 🤓.
See job ad for details jobs.uni-graz.at/en/jobs/7d14...
Reposted by Matthias Orlikowski
Planning on printing your #EMNLP2025 poster in Suzhou? There is an easy option available through the conference website: 2025.emnlp.org/poster-print...
Poster Printing
EMNLP 2025 Poster Printing
2025.emnlp.org
October 21, 2025 at 1:58 PM
Planning on printing your #EMNLP2025 poster in Suzhou? There is an easy option available through the conference website: 2025.emnlp.org/poster-print...
Reposted by Matthias Orlikowski
“You speak Bavarian? Then you must be uneducated + closed-minded.”
🤯 Not your opinion? Good. But it might be your LLM’s!!
🧵 Check out our #EMNLP2025 paper, where we uncover concerning dialect bias in recent LLMs - including GPT-5.
#AI #Bias #Dialect #Fairness #LLM #NLProc #Safety
🤯 Not your opinion? Good. But it might be your LLM’s!!
🧵 Check out our #EMNLP2025 paper, where we uncover concerning dialect bias in recent LLMs - including GPT-5.
#AI #Bias #Dialect #Fairness #LLM #NLProc #Safety
September 23, 2025 at 8:27 AM
Reposted by Matthias Orlikowski
I have two fully funded PhD positions in my group. If you want to work on persona based dialogical models or using LLMs to fight online harms then consider applying!
📢 Do you want to join our group? We opened **two** calls for a fully funded PhD. Details are in the image and at the following links.
Calls: iecs.unitn.it/education/ad...
PhD Details: iecs.unitn.it/education/ad...
Deadline: August 22nd, 2025, hrs. 04:00 PM (CEST)
Calls: iecs.unitn.it/education/ad...
PhD Details: iecs.unitn.it/education/ad...
Deadline: August 22nd, 2025, hrs. 04:00 PM (CEST)
August 6, 2025 at 8:41 AM
I have two fully funded PhD positions in my group. If you want to work on persona based dialogical models or using LLMs to fight online harms then consider applying!
Reposted by Matthias Orlikowski
Super excited to see the growing interest and awareness in diversity, variation, and pluralistic alignment in the NLP community! ✨ 🪩
Below 🧵 are some keynote talks and workshops that highlight this important direction 🤸
Below 🧵 are some keynote talks and workshops that highlight this important direction 🤸
July 31, 2025 at 2:50 PM
Super excited to see the growing interest and awareness in diversity, variation, and pluralistic alignment in the NLP community! ✨ 🪩
Below 🧵 are some keynote talks and workshops that highlight this important direction 🤸
Below 🧵 are some keynote talks and workshops that highlight this important direction 🤸
Reposted by Matthias Orlikowski
We’re incredibly proud to announce that our lab received two #ACL2025 awards: Best Social Impact Paper for @elisabassignana.bsky.social and @dirkhovy.bsky.social , and Outstanding Paper for @paul-rottger.bsky.social.
Congratulations to them and to all collaborators who made this possible!
Congratulations to them and to all collaborators who made this possible!
July 30, 2025 at 3:31 PM
We’re incredibly proud to announce that our lab received two #ACL2025 awards: Best Social Impact Paper for @elisabassignana.bsky.social and @dirkhovy.bsky.social , and Outstanding Paper for @paul-rottger.bsky.social.
Congratulations to them and to all collaborators who made this possible!
Congratulations to them and to all collaborators who made this possible!
Reposted by Matthias Orlikowski
Just arrived in Vienna for ACL 2025 🇦🇹 Excited to be here and to finally meet so many people in person!
We have several papers this year and many from @milanlp.bsky.social are around, come say hi!
Here are all the works I'm involved in ⤵️
#ACL2025 #ACL2025NLP
We have several papers this year and many from @milanlp.bsky.social are around, come say hi!
Here are all the works I'm involved in ⤵️
#ACL2025 #ACL2025NLP
🎉 The @milanlp.bsky.social lab is excited to present 15 papers and 1 tutorial at #ACL2025 & workshops! Grateful to all our amazing collaborators, see everyone in Vienna! 🚀
July 27, 2025 at 10:29 AM
Just arrived in Vienna for ACL 2025 🇦🇹 Excited to be here and to finally meet so many people in person!
We have several papers this year and many from @milanlp.bsky.social are around, come say hi!
Here are all the works I'm involved in ⤵️
#ACL2025 #ACL2025NLP
We have several papers this year and many from @milanlp.bsky.social are around, come say hi!
Here are all the works I'm involved in ⤵️
#ACL2025 #ACL2025NLP
Reposted by Matthias Orlikowski
*pluralism* in human values & preferences (e.g. with personalisation) will also just
grow more important for a global diversity of users.
@morlikow.bsky.social is presenting our poster today at 1100. Also hyped for @michaelryan207.bsky.social's work and @verenarieser.bsky.social's keynote!
grow more important for a global diversity of users.
@morlikow.bsky.social is presenting our poster today at 1100. Also hyped for @michaelryan207.bsky.social's work and @verenarieser.bsky.social's keynote!
July 28, 2025 at 6:13 AM
*pluralism* in human values & preferences (e.g. with personalisation) will also just
grow more important for a global diversity of users.
@morlikow.bsky.social is presenting our poster today at 1100. Also hyped for @michaelryan207.bsky.social's work and @verenarieser.bsky.social's keynote!
grow more important for a global diversity of users.
@morlikow.bsky.social is presenting our poster today at 1100. Also hyped for @michaelryan207.bsky.social's work and @verenarieser.bsky.social's keynote!
Reposted by Matthias Orlikowski
Very excited about all these papers on sociotechnical alignment & the societal impacts of AI at #ACL2025.
As is now tradition, I made some timetables to help me find my way around. Sharing here in case others find them useful too :) 🧵
As is now tradition, I made some timetables to help me find my way around. Sharing here in case others find them useful too :) 🧵
July 28, 2025 at 6:13 AM
Very excited about all these papers on sociotechnical alignment & the societal impacts of AI at #ACL2025.
As is now tradition, I made some timetables to help me find my way around. Sharing here in case others find them useful too :) 🧵
As is now tradition, I made some timetables to help me find my way around. Sharing here in case others find them useful too :) 🧵
Reposted by Matthias Orlikowski
📢 ACL 2025 this is a reminder of 🎤 #InvitedTalk by Verena Rieser from Google DeepMind "Whose Gold? Re-imagining Alignment for Truly Beneficial AI." on the technical & ethical challenges of building beneficial AI! 🤝 ⚖️ #ACL2025NLP #NLProc
Find out more: 2025.aclweb.org/program/keyn...
Find out more: 2025.aclweb.org/program/keyn...
July 16, 2025 at 6:00 PM
📢 ACL 2025 this is a reminder of 🎤 #InvitedTalk by Verena Rieser from Google DeepMind "Whose Gold? Re-imagining Alignment for Truly Beneficial AI." on the technical & ethical challenges of building beneficial AI! 🤝 ⚖️ #ACL2025NLP #NLProc
Find out more: 2025.aclweb.org/program/keyn...
Find out more: 2025.aclweb.org/program/keyn...
Reposted by Matthias Orlikowski
Looking forward to #acl2025 in Vienna! Excited to catch up. I am also hiring, one fully paid (100% E13) position for either a PhD student or a PostDoc in computational linguistics / digital humanities / corpus linguistics (earliest start date: October 2025). Who is interested?
July 25, 2025 at 1:15 PM
Looking forward to #acl2025 in Vienna! Excited to catch up. I am also hiring, one fully paid (100% E13) position for either a PhD student or a PostDoc in computational linguistics / digital humanities / corpus linguistics (earliest start date: October 2025). Who is interested?
Who's presenting on subjectivity in annotation (human label variation, learning from disagreement, perspectivism) at #ACL2025?
papers by e.g. @liweijiang.bsky.social @tiancheng.bsky.social @gabriellalapesa.bsky.social @romanklinger.de
keynote @verenarieser.bsky.social
link to full list below ⤵️
papers by e.g. @liweijiang.bsky.social @tiancheng.bsky.social @gabriellalapesa.bsky.social @romanklinger.de
keynote @verenarieser.bsky.social
link to full list below ⤵️
July 24, 2025 at 4:58 PM
Who's presenting on subjectivity in annotation (human label variation, learning from disagreement, perspectivism) at #ACL2025?
papers by e.g. @liweijiang.bsky.social @tiancheng.bsky.social @gabriellalapesa.bsky.social @romanklinger.de
keynote @verenarieser.bsky.social
link to full list below ⤵️
papers by e.g. @liweijiang.bsky.social @tiancheng.bsky.social @gabriellalapesa.bsky.social @romanklinger.de
keynote @verenarieser.bsky.social
link to full list below ⤵️
Reposted by Matthias Orlikowski
🗣️ Excited to share our new #ACL2025 Findings paper: “Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks” with Jad Kabbara and Deb Roy. Arxiv: arxiv.org/abs/2507.15821
Read about our findings ⤵️
Read about our findings ⤵️
Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks
LLM use in annotation is becoming widespread, and given LLMs' overall promising performance and speed, simply "reviewing" LLM annotations in interpretive tasks can be tempting. In subjective annotatio...
arxiv.org
July 22, 2025 at 8:32 AM
🗣️ Excited to share our new #ACL2025 Findings paper: “Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks” with Jad Kabbara and Deb Roy. Arxiv: arxiv.org/abs/2507.15821
Read about our findings ⤵️
Read about our findings ⤵️
I will be at #acl2025 to present "Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions" ✨
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
July 20, 2025 at 3:23 PM
I will be at #acl2025 to present "Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions" ✨
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰
more below
Reposted by Matthias Orlikowski
🎉 The @milanlp.bsky.social lab is excited to present 15 papers and 1 tutorial at #ACL2025 & workshops! Grateful to all our amazing collaborators, see everyone in Vienna! 🚀
July 16, 2025 at 12:11 PM
🎉 The @milanlp.bsky.social lab is excited to present 15 papers and 1 tutorial at #ACL2025 & workshops! Grateful to all our amazing collaborators, see everyone in Vienna! 🚀
Reposted by Matthias Orlikowski
I'll be presenting this tutorial in Vienna with co-organisers @daniel-russo.bsky.social, @helenabon.bsky.social, Yi-Ling Chung, @marcoguerini.bsky.social and invited civil society speakers Cathy Buerger (@dangerousspeech.org) and @simofons.bsky.social (Facta). Come along or join online!
🗣️ Discover "NLP for Counterspeech against Hate and Misinformation" at #ACL2025NLP! This tutorial bridges CS, social sciences & policy, exploring among others the role of LLMs. #HateSpeech #Misinformation #NLProc #ResponsibleAI
👉 2025.aclweb.org/program/tuto...
👉 2025.aclweb.org/program/tuto...
Tutorials
ACL 2025 Conference Overview.
2025.aclweb.org
June 3, 2025 at 10:52 AM
I'll be presenting this tutorial in Vienna with co-organisers @daniel-russo.bsky.social, @helenabon.bsky.social, Yi-Ling Chung, @marcoguerini.bsky.social and invited civil society speakers Cathy Buerger (@dangerousspeech.org) and @simofons.bsky.social (Facta). Come along or join online!
Reposted by Matthias Orlikowski
🚨 New paper accepted at #ACL2025 Main conference! 🙌
"The AI Gap: How Socioeconomic Status Affects Language Technology Interactions"
w/ @amandacurry.bsky.social & @dirkhovy.bsky.social
Very happy for this first collab with @milanlp.bsky.social 🤝
🔗 lnkd.in/dtsH3gaX
🤗 lnkd.in/d7diuBJh
🧵👇
#ACL2025
"The AI Gap: How Socioeconomic Status Affects Language Technology Interactions"
w/ @amandacurry.bsky.social & @dirkhovy.bsky.social
Very happy for this first collab with @milanlp.bsky.social 🤝
🔗 lnkd.in/dtsH3gaX
🤗 lnkd.in/d7diuBJh
🧵👇
#ACL2025
May 26, 2025 at 10:21 AM
🚨 New paper accepted at #ACL2025 Main conference! 🙌
"The AI Gap: How Socioeconomic Status Affects Language Technology Interactions"
w/ @amandacurry.bsky.social & @dirkhovy.bsky.social
Very happy for this first collab with @milanlp.bsky.social 🤝
🔗 lnkd.in/dtsH3gaX
🤗 lnkd.in/d7diuBJh
🧵👇
#ACL2025
"The AI Gap: How Socioeconomic Status Affects Language Technology Interactions"
w/ @amandacurry.bsky.social & @dirkhovy.bsky.social
Very happy for this first collab with @milanlp.bsky.social 🤝
🔗 lnkd.in/dtsH3gaX
🤗 lnkd.in/d7diuBJh
🧵👇
#ACL2025
Reposted by Matthias Orlikowski
Had the chance to revamp a PhD class on CSS. We're now using Colab notebooks to use Python for data analysis.
Check out the new syllabus (w/ reading, slides, background notebooks, and exercises plus solutions).
📚👇 bit.ly/438R6Hk
#ComputationalSocialScience #PhD
Check out the new syllabus (w/ reading, slides, background notebooks, and exercises plus solutions).
📚👇 bit.ly/438R6Hk
#ComputationalSocialScience #PhD
Syllabus
Syllabus: Computational Methods for Social and Political Science, Spring 2025 Recommended Reading: Christian, B., & Griffiths, T. (2016). Algorithms to live by: The computer science of human decisio...
docs.google.com
May 23, 2025 at 7:40 AM
Had the chance to revamp a PhD class on CSS. We're now using Colab notebooks to use Python for data analysis.
Check out the new syllabus (w/ reading, slides, background notebooks, and exercises plus solutions).
📚👇 bit.ly/438R6Hk
#ComputationalSocialScience #PhD
Check out the new syllabus (w/ reading, slides, background notebooks, and exercises plus solutions).
📚👇 bit.ly/438R6Hk
#ComputationalSocialScience #PhD
Reposted by Matthias Orlikowski
Incredible! "Content moderators who comb through harmful material uploaded to online platforms have formed a global trade union alliance...to improve working conditions. The Global Trade Union Alliance of Content Moderators (GTUACM) announced today in Nairobi"
www.theverge.com/news/658566/...
www.theverge.com/news/658566/...
Content moderators are organizing against Big Tech
Workers are fighting for working conditions and mental health support.
www.theverge.com
May 5, 2025 at 4:08 PM
Incredible! "Content moderators who comb through harmful material uploaded to online platforms have formed a global trade union alliance...to improve working conditions. The Global Trade Union Alliance of Content Moderators (GTUACM) announced today in Nairobi"
www.theverge.com/news/658566/...
www.theverge.com/news/658566/...
Reposted by Matthias Orlikowski
📢 Breaking changes to EMNLP submissions! If you plan to submit, pls make sure ALL co-authors know that:
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
📢 Planning to submit to EMNLP 2025?
Make sure you're up to speed with new ARR policies:
👉 aclrollingreview.org/incentives2025
#NLProc #EMNLP #ARR #ACL (1/2)
Make sure you're up to speed with new ARR policies:
👉 aclrollingreview.org/incentives2025
#NLProc #EMNLP #ARR #ACL (1/2)
Changes to reviewer volunteering requirement and incentives in May 2025 cycle (EMNLP 2025)
TLDR:
aclrollingreview.org
May 5, 2025 at 11:19 AM
📢 Breaking changes to EMNLP submissions! If you plan to submit, pls make sure ALL co-authors know that:
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
Reposted by Matthias Orlikowski
We (w/ @diyiyang.bsky.social, @zhuhao.me, & Bodhisattwa Prasad Majumder) are excited to present our #NAACL25 tutorial on Social Intelligence in the Age of LLMs!
It will highlight long-standing and emerging challenges of AI interacting w humans, society & the world.
⏰ May 3, 2:00pm-5:30pm Room Pecos
It will highlight long-standing and emerging challenges of AI interacting w humans, society & the world.
⏰ May 3, 2:00pm-5:30pm Room Pecos
May 3, 2025 at 1:58 PM
We (w/ @diyiyang.bsky.social, @zhuhao.me, & Bodhisattwa Prasad Majumder) are excited to present our #NAACL25 tutorial on Social Intelligence in the Age of LLMs!
It will highlight long-standing and emerging challenges of AI interacting w humans, society & the world.
⏰ May 3, 2:00pm-5:30pm Room Pecos
It will highlight long-standing and emerging challenges of AI interacting w humans, society & the world.
⏰ May 3, 2:00pm-5:30pm Room Pecos
Reposted by Matthias Orlikowski
Happening now at #COMPTEXT2025 in a fantastic panel on "Advances in Misinformation, Toxicity & Hate Speech Detection" 👏
@pia-p.bsky.social presenting our latest work on how a more Perspectivist approach to NLP for algorithmic moderation could account for users’ differing views on what is harmful 🤔
@pia-p.bsky.social presenting our latest work on how a more Perspectivist approach to NLP for algorithmic moderation could account for users’ differing views on what is harmful 🤔
April 25, 2025 at 10:12 AM
Happening now at #COMPTEXT2025 in a fantastic panel on "Advances in Misinformation, Toxicity & Hate Speech Detection" 👏
@pia-p.bsky.social presenting our latest work on how a more Perspectivist approach to NLP for algorithmic moderation could account for users’ differing views on what is harmful 🤔
@pia-p.bsky.social presenting our latest work on how a more Perspectivist approach to NLP for algorithmic moderation could account for users’ differing views on what is harmful 🤔