Ben Schneider
banner
bschneidr.bsky.social
Ben Schneider
@bschneidr.bsky.social
Stats, surveys, R, and dogs.
www.practicalsignificance.com
Reposted by Ben Schneider
We're hiring an open-source #python developer focused on modeling APIs!

tidyverse.org/blog/2025/11...

#numpy #scipy #scikitlearn
Python Open-Source Developer
Posit is hiring a Python open-source developer to create more data analysis tools.
tidyverse.org
November 12, 2025 at 5:46 PM
This profile in ‘Significance’ on DuckDB co-founder Hannes Mühleisen is quite interesting, and has helpful insights about data quality and the changing meaning of “big data.” Also some good professional advice in here for statisticians.

academic.oup.com/jrssig/artic...
Is big data dead?
Abstract. Data, ducks and statistics – Sandra Alba gathers dispatches from Amsterdam and Auckland
academic.oup.com
November 9, 2025 at 5:47 PM
Reposted by Ben Schneider
pre-writing a devastating obituary for your enemy is god-tier hating of a kind you don’t often see anymore. renaissance haterism. beautiful stuff.
A Sharon Begley byline, almost 5 years after her death.

Upon hearing the news James Watson had died, a STAT reporter said in our Slack, "I wish I could read what Sharon would have written."

Incredible news: Sharon in fact did pre-write a Watson obit. And it is masterful and excoriating.
🧪🧬🧫
James Watson, dead at 97, was a scientific legend and a pariah among his peers
James Watson, the co-discoverer of the structure of DNA who died Thursday at 97, was a scientific legend and a pariah among his peers.
www.statnews.com
November 9, 2025 at 12:55 AM
Reposted by Ben Schneider
#rstats
Vectorisation is urbanism
November 8, 2025 at 9:09 PM
Reposted by Ben Schneider
🌈 The website for the inaugural rainbowR conference is now live! 🎉

🗓️ Save the date: Feb 25th-26th, 2026

📣 Call for submissions is open

👯 We're bringing together LGBTQ+ R users to promote our work and foster connections among community members

conference.rainbowr.org
– rainbowR conference
conference.rainbowr.org
November 6, 2025 at 3:56 PM
Reposted by Ben Schneider
One analytical model shows that, as of November 5th, the dismantling of U.S.A.I.D. has already caused the deaths of 600,000 people, two-thirds of them children. https://newyorkermag.visitlink.me/jUzNSc
The Shutdown of U.S.A.I.D. Has Already Killed Hundreds of Thousands
The short documentary “Rovina’s Choice” tells the story of what goes when aid goes.
newyorkermag.visitlink.me
November 6, 2025 at 9:00 PM
Reposted by Ben Schneider
New blog post: open-source software packages have surprising problems with the way they calculate weighted medians and other quantiles.

www.practicalsignificance.com/posts/weight...

#rstats #julialang
Weighted Quantile Weirdness and Bugs – Practical Significance
Computing quantiles is surprisingly complicated. It gets much weirder when you use weights, and popular software behaves in surprising ways that might trouble you.
www.practicalsignificance.com
November 5, 2025 at 4:30 PM
New blog post: open-source software packages have surprising problems with the way they calculate weighted medians and other quantiles.

www.practicalsignificance.com/posts/weight...

#rstats #julialang
Weighted Quantile Weirdness and Bugs – Practical Significance
Computing quantiles is surprisingly complicated. It gets much weirder when you use weights, and popular software behaves in surprising ways that might trouble you.
www.practicalsignificance.com
November 5, 2025 at 4:30 PM
Reposted by Ben Schneider
In which use cases does #RStats excel for you compared to other languages?

If you've done it other ways and speak from experience, even better.
October 30, 2025 at 12:12 AM
Reposted by Ben Schneider
There's going to be a lot of focus on the topline -- that polling was more accurate than in 2016 and 2020 but still biased towards Dems on average by 2.7 pp -- but I want to highlight some of the other findings I found most interesting
🚨It's finally here!🚨
AAPOR's Taskforce on 2024 Pre-Election Polling report is out!

Full report: /https://aapor.org/wp-content/uploads/2025/10/AAPOR-Task-Force-on-2024-Pre-Election-Polling_Report.pdf

Executive summary: aapor.org/wp-content/u...
aapor.org
October 29, 2025 at 6:56 PM
Reposted by Ben Schneider
take this quiz then tell me you can win over low-info "moderates" on policy

it's just vibes all the way down
October 29, 2025 at 3:50 PM
Reposted by Ben Schneider
Packages are essential to the #rstats ecosystem for sharing code, data, and documentation.
Join @ellakaye.co.uk's #GESISworkshop to learn how to write your own R 📦 from scratch, covering the whole process from setup to publication

More information & registration ➡️ t1p.de/R_Pack_Dev_25
September 10, 2025 at 11:29 AM
Reposted by Ben Schneider
Woot, just submitted another dataset to #TidyTuesday and now there are 5 PRs waiting for Jon to review.

I screenrecorded the process, so if you want to see how EASY it is to contribute a dataset to this AMAZING #rstats community, check out this video.

youtu.be/Kp7pyYwLcwc
October 28, 2025 at 10:32 PM
Reposted by Ben Schneider
The Python Software Foundation got a competitive US research grant, but it came with a condition that they recant and abjure any diversity and inclusion ideas, on penalty of having to repay the money.

Obviously this is not desirable or safe, so no grant.

Donations would help them not regret this
The PSF has withdrawn $1.5 million proposal to US government grant program
In January 2025, the PSF submitted a proposal to the US government National Science Foundation under the Safety, Security, and Privacy of Open Source Ecosystems program to address structural vulnerabilities in Python and PyPI. It was the PSF’s first time applying for government funding, and navigating the intensive process was a steep learning curve for our small team to climb. Seth Larson, PSF Security Developer in Residence, serving as Principal Investigator (PI) with Loren Crary, PSF Deputy Executive Director, as co-PI, led the multi-round proposal writing process as well as the months-long vetting process. We invested our time and effort because we felt the PSF’s work is a strong fit for the program and that the benefit to the community if our proposal were accepted was considerable. We were honored when, after many months of work, our proposal was recommended for funding, particularly as only 36% of new NSF grant applicants are successful on their first attempt. We became concerned, however, when we were presented with the terms and conditions we would be required to agree to if we accepted the grant. These terms included affirming the statement that we “do not, and will not during the term of this financial assistance award, operate any programs that advance or promote DEI, or discriminatory equity ideology in violation of Federal anti-discrimination laws.” This restriction would apply not only to the security work directly funded by the grant, **but to any and all activity of the PSF as a whole**. Further, violation of this term gave the NSF the right to “claw back” previously approved and transferred funds. This would create a situation where money we’d already spent could be taken back, which would be an enormous, open-ended financial risk. Diversity, equity, and inclusion are core to the PSF’s values, as committed to in our mission statement: > _The mission of the Python Software Foundation is to promote, protect, and advance the Python programming language, and to support and facilitate the growth of**a diverse and international community** of Python programmers._ Given the value of the grant to the community and the PSF, we did our utmost to get clarity on the terms and to find a way to move forward in concert with our values. We consulted our NSF contacts and reviewed decisions made by other organizations in similar circumstances, particularly The Carpentries. In the end, however, the PSF simply can’t agree to a statement that we won’t operate any programs that “advance or promote” diversity, equity, and inclusion, as it would be a betrayal of our mission and our community. We’re disappointed to have been put in the position where we had to make this decision, because we believe our proposed project would offer invaluable advances to the Python and greater open source community, protecting millions of PyPI users from attempted supply-chain attacks. The proposed project would create new tools for automated proactive review of all packages uploaded to PyPI, rather than the current process of reactive-only review. These novel tools would rely on capability analysis, designed based on a dataset of known malware. Beyond just protecting PyPI users, the outputs of this work could be transferable for all open source software package registries, such as NPM and Crates.io, improving security across multiple open source ecosystems. In addition to the security benefits, the grant funds would have made a big difference to the PSF’s budget. The PSF is a relatively small organization, operating with an annual budget of around $5 million per year, with a staff of just 14. $1.5 million over two years would have been quite a lot of money for us, and easily the largest grant we’d ever received. Ultimately, however, the value of the work and the size of the grant were not more important than practicing our values and retaining the freedom to support every part of our community. The PSF Board voted unanimously to withdraw our application. Giving up the NSF grant opportunity—along with inflation, lower sponsorship, economic pressure in the tech sector, and global/local uncertainty and conflict—means the PSF needs financial support now more than ever. We are incredibly grateful for any help you can offer. If you're already a PSF member or regular donor, you have our deep appreciation, and we urge you to share your story about why you support the PSF. Your stories make all the difference in spreading awareness about the mission and work of the PSF. How to support the PSF: * Become a Member: When you sign up as a Supporting Member of the PSF, you become a part of the PSF. You’re eligible to vote in PSF elections, using your voice to guide our future direction, and you help us sustain what we do with your annual support. * Donate: Your donation makes it possible to continue our work supporting Python and its community, year after year. * Sponsor: If your company uses Python and isn’t yet a sponsor, send them our sponsorship page or reach out to sponsors@python.org today. The PSF is ever grateful for our sponsors, past and current, and we do everything we can to make their sponsorships beneficial and rewarding.
pyfound.blogspot.com
October 28, 2025 at 7:16 AM
Reposted by Ben Schneider
I'm an #RStats users, but I know some of the R 📦s I use have reticulate + Python under the hood. Thank you @python.org for standing up for everyone in your community. I've made a small donation, hopefully a lot of small $$ can help fund what's needed.
TLDR; The PSF has made the decision to put our community and our shared diversity, equity, and inclusion values ahead of seeking $1.5M in new revenue. Please read and share. pyfound.blogspot.com/2025/10/NSF-...
🧵
The official home of the Python Programming Language
www.python.org
October 28, 2025 at 2:38 AM
Reposted by Ben Schneider
Really interesting work (and thoughts on experimental design)!
After a huge post-election flip in economic perceptions, I thought Democrats and Republicans might be lying to pollsters to send a partisan message — but I was wrong!

New in the Journal of Experimental Political Science (open access): doi.org/10.1017/XPS....
October 27, 2025 at 4:33 PM
Reposted by Ben Schneider
Catch @kylewalker.bsky.social (of tidycensus fame) for the AI • R meetup!

🗺️ Pragmatic development with AI in Spatial, R, and OSS development.
📅 October 29 at 2:30 pm ET

Register here: bit.ly/RxAI-join

#RStats
October 27, 2025 at 2:44 PM
Reposted by Ben Schneider
@dataindex.us @publicenvirodata.bsky.social and Federation of American Scientists (FAS) have set up a campaign this Halloween season. Nominate your favorite Dearly Departed Datasets now: www.datarescueproject.org/support-dear...
Support Dearly Departed Datasets
Our federal data is meeting an untimely end. Help track their final days. 🪦
www.datarescueproject.org
October 27, 2025 at 7:21 PM
Reposted by Ben Schneider
The government shutdown is halting the collection and release of statistics tracking the job market, public health and crop production, as well as other economic indicators.

www.axios.com/2025/10/26/s...
Government shutdown leaves the economy in uncharted territory
The shutdown is halting the collection and release of statistics tracking the job market, public health and crop production.
www.axios.com
October 27, 2025 at 4:28 PM
Reposted by Ben Schneider
TLDR; The PSF has made the decision to put our community and our shared diversity, equity, and inclusion values ahead of seeking $1.5M in new revenue. Please read and share. pyfound.blogspot.com/2025/10/NSF-...
🧵
The official home of the Python Programming Language
www.python.org
October 27, 2025 at 2:47 PM
Reposted by Ben Schneider
It’s fun to look at this ai slop nazi propaganda and then remember what these guys actually look like. This isn’t what they (or america) looks like and far from loving america, this is an expression of severe self loathing bsky.app/profile/geof...
I made an image of all the art posted by US DOL on X since approximately Labor Day
October 26, 2025 at 1:08 PM
Reposted by Ben Schneider
reticulate v1.44 is on CRAN!

Positron integration is now enabled by default. Enjoy R and Python REPL consoles powered by concurrent threads in the same process, zero‑copy R↔Python data transfer, and full Variables Pane support.

Full changelog: github.com/rstudio/reti...

#rstats #python #pydata
github.com
October 25, 2025 at 3:37 PM
Reposted by Ben Schneider
This is a good example of why I yell at people for sharing poll results as screenshots/text without linking back to the actual poll toplines. It breaks the chain of information and makes it way easier for bad actors to thrive.
This ME-Sen poll and this account are fake. No such poll on Emerson Polling's website or X feed. And take a close look at the account's handle: @PoliticPollss when the real one it's impersonating is @Politics_Polls.
October 24, 2025 at 6:18 PM
Reposted by Ben Schneider
Statisticians Warn House Bill Provision Would Drive up Census Costs While Reducing Accuracy

thecensusproject.org/2025/10/22/s...
Statisticians Warn House Bill Provision Would Drive up Census Costs While Reducing Accuracy - The Census Project
Statisticians are concerned that Section 605 in the House Fiscal
thecensusproject.org
October 22, 2025 at 9:37 PM