I'd love to chat with you about it! Download data here behavioral-data.github.io/moderator_pe...

In the paper, we assess rule enforcement👮‍♀️, moderator workload😵,and moderator engagement🤝.

We developed the first automatic method to measure governance outcomes, by looking at how community members talk about their moderators.🗣️We collect all discussion for the top 10k subreddits over 5+ years💾 which we make public!

Moderators face lots of decisions about how to moderate.🤷‍♀️How can we empirically determine the best moderation practices?🤔Surveys don't scale! 📋

Come to our talk in the 1pm session to learn more, and check out our paper:
ojs.aaai.org/index.php/IC...

Amongst other things, we find that rules phrased prescriptively (“do this”) are received more positively than those phrased restrictively (“don’t do that”), and that the effect of adding new rules is initially positive, but wears off after ~ 6 months.

We associate these rules with key community outcomes: how do community members talk about their moderators? We classify comments discussing moderators according to their sentiment, and we make these datasets public.

We classify rules from 5.2k subreddits, capturing more than 2/3s of all activity on reddit, according to their tone (does the rule say what or what not do do), target (does the rule address content, formatting, or users) and topic (twelve specific topics).

We've got a great set of authors including @skairam.bsky.social @mbernst.bsky.social @ceshwar.bsky.social @cfiesler.bsky.social @estellesmithphd.bsky.social!

More details here: programs.sigchi.org/cscw/2024/pr...