Prolific
@joinprolific.bsky.social
The ultimate human data platform to power world-changing AI and research.
🔗 www.prolific.com
🔗 www.prolific.com
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
November 12, 2025 at 4:09 PM
We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Our metrics include:
⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
November 6, 2025 at 4:23 PM
Protocol is our five-layer system built to ensure your data is of the highest quality.
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.
#AcademicSky #Research
Ongoing human oversight and fine-tuning of our data quality systems is also crucial in protecting good participants and research integrity.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
November 5, 2025 at 5:21 PM
Ongoing human oversight and fine-tuning of our data quality systems is also crucial in protecting good participants and research integrity.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.
We architect authentic data through Protocol, a state-of-the-art system that sets the industry standard for data quality. With five layers of defense, it ensures every response on our platform is authentically human.
Each layer is detailed in the full article.
Each layer is detailed in the full article.
November 5, 2025 at 5:21 PM
We architect authentic data through Protocol, a state-of-the-art system that sets the industry standard for data quality. With five layers of defense, it ensures every response on our platform is authentically human.
Each layer is detailed in the full article.
Each layer is detailed in the full article.
We put authenticity above all else.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
November 5, 2025 at 5:21 PM
We put authenticity above all else.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
Independent research validates Prolific as setting the standard for data quality (2017-2025). Only 0.5% of Prolific participant responses were rejected in 2025. And a recent audit shows that just 0.99% of participants were flagged for AI-generated responses.
When you commission human data, you deserve human data.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
November 5, 2025 at 5:21 PM
When you commission human data, you deserve human data.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
Our commitment to data integrity remains constant. Protecting access to real human perspectives has been Prolific’s top priority since its inception in 2014.
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
November 5, 2025 at 5:21 PM
In an AI-powered world, genuine human perspectives are both precious and vulnerable.
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
The line between human and AI-generated responses is blurring, threatening the very foundation of academic research.
Our approach to protecting data integrity 🧵 #AcademicSky #Research
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
October 28, 2025 at 11:25 AM
🎓 Great news for academic researchers - our $100 / £100 free credit offer has been extended!
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Sign up with your university email to collect fast, high-quality data from 200K+ vetted participants across the globe.
👉 www.prolific.com/academic-res...
#AcademicSky #PhDSky #AcademicResearch
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
October 22, 2025 at 2:36 PM
Limited time offer for academic researchers 🚨
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
Get $100 / £100 free credit this October to run your next study with fast, high-quality data from 200K+ verified participants on Prolific.
Sign up and redeem: www.prolific.com/academic-res...
#AcademicSky #PhDSky #Researchers
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
October 9, 2025 at 11:53 AM
📢 Authenticity checks are out of beta, with upgrades for ease of use.
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Authenticity checks work with Qualtrics and Prolific to detect AI-generated responses in your research with 98.7% precision, so you can trust the data you collect is authentic.
#AcademicSky #ResearchIntegrity #AIDetection
Probability of Practical Superiority (PPS) Comparison Matrix is available under "Model Comparison" for estimating how likely one model is likely to outperform another in real-world usage.
Values >55% suggest one model meaningfully outperforms beyond random chance.
Values >55% suggest one model meaningfully outperforms beyond random chance.
September 17, 2025 at 4:13 PM
Probability of Practical Superiority (PPS) Comparison Matrix is available under "Model Comparison" for estimating how likely one model is likely to outperform another in real-world usage.
Values >55% suggest one model meaningfully outperforms beyond random chance.
Values >55% suggest one model meaningfully outperforms beyond random chance.
HUMAINE uses rigorous methodology to ensure representative and reliable results.
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
September 17, 2025 at 4:13 PM
HUMAINE uses rigorous methodology to ensure representative and reliable results.
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
Our methodology includes:
- Comparative assessment
- Statistically rigorous hierarchical modeling
- Four core dimensions of user experience and overall winner
- Commitment to demographic representation
🏆 Gemini-2.5-Pro takes the #1 spot decisively, with DeepSeek-V3 emerging as the surprise runner-up.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
September 17, 2025 at 4:13 PM
🏆 Gemini-2.5-Pro takes the #1 spot decisively, with DeepSeek-V3 emerging as the surprise runner-up.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
⚖️ Age groups show highest disagreement on model rankings.
📊 27 models tested across 100K+ human comparisons - one of the largest public AI evaluations to date.
Our human-centered evaluation and leaderboard shows how people actually experience AI models in the real world.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
September 17, 2025 at 4:13 PM
Our human-centered evaluation and leaderboard shows how people actually experience AI models in the real world.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Rich, multi-dimensional feedback from a diverse, representative sample of real users from our pool - revealing not just which model they prefer, but why.
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
September 17, 2025 at 4:13 PM
Introducing HUMAINE: the LLM benchmark that puts real human experience first 🎯
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
21,352 human evaluators. 27 models. 22 demographic groups. 5 evaluation dimensions.
In partnership with @hf.co. See insights: huggingface.co/spaces/Proli...
More in 🧵 #ArtificialIntelligence #MLSky #LLM #Developer
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
September 11, 2025 at 7:43 PM
New: Periodic identity confirmation checks with video recording to ensure authentic, human feedback in your academic and industry research.
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
Along with bank-grade ID verification, this ensures participants are who they say they are—not bots, duplicates, or fraud.
#AcademicSky #ResearchIntegrity
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
August 21, 2025 at 10:11 AM
🔍 Audience Finder is here.
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
Instantly check if the participants you need for your research are on Prolific. No set-up required.
Just type who you’re looking for (“Bilingual psychologists who speak Mandarin”) and see live results in seconds.
➡️ www.prolific.com/audience-fin... | #AcademicSky
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
August 18, 2025 at 5:29 PM
In the age of AI, authenticity matters more than ever in academic research. LLM-generated responses, false demographics, and more pose a threat.
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
VP of Product Sara details tools and internal measures we’ve implemented to help maintain research integrity 🧵
#AcademicSky #ResearchIntegrity
Interesting findings around how agents compete with humans for partnerships by @yaominj.bsky.social, @levinbrinkmann.bsky.social, Anne-Marie Nussberger, Ivan Soraperra, @jfbonnefon.bsky.social, @iyadrahwan.bsky.social, @mpib-berlin.bsky.social.
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
August 4, 2025 at 8:17 PM
Interesting findings around how agents compete with humans for partnerships by @yaominj.bsky.social, @levinbrinkmann.bsky.social, Anne-Marie Nussberger, Ivan Soraperra, @jfbonnefon.bsky.social, @iyadrahwan.bsky.social, @mpib-berlin.bsky.social.
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
Taskers sourced via Prolific.
#AI #MLSky #AcademicSky
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524
August 4, 2025 at 8:17 PM
"Through three experiments (N = 975), we found that bots, though more prosocial than humans and linguistically distinguishable, were not selected preferentially when their identity was hidden. Instead, humans misattributed bots’ behavior to humans and vice versa."
arxiv.org/abs/2507.13524
arxiv.org/abs/2507.13524
The largest investigation of AI persuasion with 76,977 participants across 3 large-scale experiments. Excellent work by @ox.ac.uk PhD candidate @kobihackenburg.bsky.social.
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
July 24, 2025 at 7:56 PM
The largest investigation of AI persuasion with 76,977 participants across 3 large-scale experiments. Excellent work by @ox.ac.uk PhD candidate @kobihackenburg.bsky.social.
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
19 LLMs. 707 political issues. 466,769 fact-checkable claims evaluated.
arxiv.org/abs/2507.13919
#AcademicSky #MLSky #PhDSky
4 new security enhancements for better data quality in your academic research 🧵
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
July 10, 2025 at 2:01 PM
4 new security enhancements for better data quality in your academic research 🧵
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
With data quality an absolute priority yet challenge for many researchers, we’ve made several important updates to strengthen security and maintain data quality on the Prolific platform.
#AcademicSky #PhDSky #Research
🎥 Webinar: Why AI leaderboards miss the mark 🚫
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
July 7, 2025 at 2:02 PM
🎥 Webinar: Why AI leaderboards miss the mark 🚫
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
@cohereforai.bsky.social’s Oliver Nan, University of Washington's @huashen.bsky.social, and Prolific’s Nora Petrova will be discussing where leaderboards are falling short, how to improve them, and more.
🔗 www.prolific.com/resources/wh... | #MLSky #AI
Pleased to have fueled some of the most fascinating research in recent years.
With features from Google DeepMind, Microsoft, MIT, and more, you can now explore impactful research and AI alignment stories empowered by Prolific's diverse participant pool.
🔗 www.prolific.com/resources?ty...
With features from Google DeepMind, Microsoft, MIT, and more, you can now explore impactful research and AI alignment stories empowered by Prolific's diverse participant pool.
🔗 www.prolific.com/resources?ty...
July 6, 2025 at 4:15 PM
Pleased to have fueled some of the most fascinating research in recent years.
With features from Google DeepMind, Microsoft, MIT, and more, you can now explore impactful research and AI alignment stories empowered by Prolific's diverse participant pool.
🔗 www.prolific.com/resources?ty...
With features from Google DeepMind, Microsoft, MIT, and more, you can now explore impactful research and AI alignment stories empowered by Prolific's diverse participant pool.
🔗 www.prolific.com/resources?ty...
Meet Protocol—Prolific’s proprietary data protection system.
For years, Protocol has been pivotal to maintaining high data quality standards on our platform through automated, continuous monitoring. Here are 3 things to know ⬇️
For years, Protocol has been pivotal to maintaining high data quality standards on our platform through automated, continuous monitoring. Here are 3 things to know ⬇️
July 3, 2025 at 3:32 PM
Meet Protocol—Prolific’s proprietary data protection system.
For years, Protocol has been pivotal to maintaining high data quality standards on our platform through automated, continuous monitoring. Here are 3 things to know ⬇️
For years, Protocol has been pivotal to maintaining high data quality standards on our platform through automated, continuous monitoring. Here are 3 things to know ⬇️