What is generalizable classification here? We think there are three key elements
1. New data domains - from short informal text to long passages.
2. New moral and value dimensions.
3. New frameworks - e.g. moral foundations, Schwartz human values, and many more!
What is generalizable classification here? We think there are three key elements
1. New data domains - from short informal text to long passages.
2. New moral and value dimensions.
3. New frameworks - e.g. moral foundations, Schwartz human values, and many more!
Our new methodology insight: "all@once LLM prompting strategy" outperforms fine-tuned models across multiple domains and frameworks. Why does it work? It uses inter-label dependencies resembling a classifier chain approach in ML.
Our new methodology insight: "all@once LLM prompting strategy" outperforms fine-tuned models across multiple domains and frameworks. Why does it work? It uses inter-label dependencies resembling a classifier chain approach in ML.
MoVa provides resources defining this generalizable classification -- 16 labeled datasets and benchmarking results across four major, theoretically-grounded frameworks: Moral Foundations Theory (MFT), Human Values, Common Morality, and Morality-as-Cooperation (MAC)
MoVa provides resources defining this generalizable classification -- 16 labeled datasets and benchmarking results across four major, theoretically-grounded frameworks: Moral Foundations Theory (MFT), Human Values, Common Morality, and Morality-as-Cooperation (MAC)
MoVa also offers a new application for evaluating psychological surveys:
By using MoVa to score the relevance of moral dimensions for each survey item, we can detect potentially multi-loaded items in instruments like MFQ, MAQ, and PVQ, helping researchers rethink questionnaire design.
MoVa also offers a new application for evaluating psychological surveys:
By using MoVa to score the relevance of moral dimensions for each survey item, we can detect potentially multi-loaded items in instruments like MFQ, MAQ, and PVQ, helping researchers rethink questionnaire design.
(1) Analyze Public Discourse: Understand the core values driving large-scale conversations on social and political issues.
(2) Build Better AI: Ensure that artificial intelligence systems communicate in a way that's aligned with basic human ethics #AIalignment
(1) Analyze Public Discourse: Understand the core values driving large-scale conversations on social and political issues.
(2) Build Better AI: Ensure that artificial intelligence systems communicate in a way that's aligned with basic human ethics #AIalignment
Future work? Generalizable classification across cultures and languages, and investigating generalisable prompting methodology on other subjective text classification tasks.
Future work? Generalizable classification across cultures and languages, and investigating generalisable prompting methodology on other subjective text classification tasks.
Led by CMlab PhD student Ziyu Chen, with @ml4x.bsky.social Junfei Sun, Chenxi Li at UChicago, @joshnguyen.bsky.social at UPenn, and Jing Yao, Xiaoyuan Yi and Xing Xie at Microsoft Research Asia
Led by CMlab PhD student Ziyu Chen, with @ml4x.bsky.social Junfei Sun, Chenxi Li at UChicago, @joshnguyen.bsky.social at UPenn, and Jing Yao, Xiaoyuan Yi and Xing Xie at Microsoft Research Asia
Read the paper here arxiv.org/abs/2509.24216
Explore the MoVa resources, data, and code supporting this work here: 👉 github.com/ZiyuChen0410...
#NLP #ResearchTools #DataScience
Read the paper here arxiv.org/abs/2509.24216
Explore the MoVa resources, data, and code supporting this work here: 👉 github.com/ZiyuChen0410...
#NLP #ResearchTools #DataScience
We are open to new algorithms, paradigms for human-AI collaboration, innovations with LLM
We are open to new algorithms, paradigms for human-AI collaboration, innovations with LLM