Eric Book
LightNews LightNews
erc-bk.fosstodon.org.ap.brid.gy
Eric Book
@erc-bk.fosstodon.org.ap.brid.gy
8 followers 7 following 79 posts
Pathologically curious about most things, but this space is mostly focused on data science and engineering.
#tfr

[bridged from https://fosstodon.org/@erc_bk on the fediverse by https://fed.brid.gy/ ]
Posts Replies Media Videos
Reposted by Eric Book
hrbrmstr.mastodon.social.ap.brid.gy
Jarl (with a Zed Extension!) by @etiennebacher is DOPE!

https://github.com/etiennebacher/jarl

So. FAST!

Need to figure out a good way to perma-eradicate the bane that is {lintr}.
GitHub - etiennebacher/jarl: Just Another R Linter
Just Another R Linter. Contribute to etiennebacher/jarl development by creating an account on GitHub.
github.com
November 19, 2025 at 10:34 PM
Reposted by Eric Book
stephenturner.us
Datanomy is a terminal-based tool for inspecting and understanding data files. It provides an interactive view of your data's structure, metadata, and internal organization. github.com/raulcd/datan...
November 19, 2025 at 12:10 PM
Reposted by Eric Book
coolbutuseless.fosstodon.org.ap.brid.gy
Make a joke map.

#fake #30DayMapChallenge #rstats
November 19, 2025 at 10:45 AM
erc-bk.fosstodon.org.ap.brid.gy
How spatial sampling methods affect the variance of your mean estimate when spatial autocorrelation is present.
https://dosull.github.io/posts/2025-11-14-gia-chapter-2A-spatial-autocorrelation/
Shows four density charts. Each chart represents a sampling method: poisson, grid, evenly spaced, and clustered.. Each chart shows two densities: random (no spatial autocorrelation) and smoothed (spatial autocorrelation). Grid and evenly spaced show too narrow variance estimates while clustered shows too wide of a variance estimate.
November 16, 2025 at 12:37 AM
Reposted by Eric Book
stephenturner.us
Recordings from posit::conf(2025) now on YouTube: www.youtube.com/playlist?lis... #Rstats
posit::conf(2025) - YouTube
Welcome to the official playlist for posit::conf(2025)! Dive into the latest innovations, cutting-edge techniques, and inspiring insights from the premier op...
www.youtube.com
November 10, 2025 at 10:37 AM
Reposted by Eric Book
gnoblet.bsky.social
Day 05 of #30DayMapChallenge on Earth (Classical Elements 1/4)

I've discovered and used the new `tmap.mapgl` to show Swizerland's elevation. It's mindblowing how easy it is.

guillaume-noblet.com/30DayMapChal...

#dataviz #rstats #tmap #gis #mapgl cc @mtennekes and thanks!
November 7, 2025 at 12:30 PM
erc-bk.fosstodon.org.ap.brid.gy
Just as I've started to get a pretty comfortable with all the coordinate representations, projections, etc., I see this. If I would've came across an older dataset with this before now, I'm not sure what I would've done. Tried an internet search out of […]

[Original post on fosstodon.org]
Shows text with geographical coordinates formatted in a number/character format, e.g. 51d56'N.
October 30, 2025 at 8:52 PM
erc-bk.fosstodon.org.ap.brid.gy
Hmm — an htmlwidget serializer. I'd like to see that out in the wild. #rstats
Shows plumber2 documentation with all available serializers listed. The htmlwidget serializer has been circled.
October 28, 2025 at 3:00 PM
Reposted by Eric Book
hrbrmstr.mastodon.social.ap.brid.gy
The GreyNoise IP Checker (https://check.labs.greynoise.io) now gives geolocation info in the header (if the IP was in GN) and populates a 90-day timeline with a summary of tags.

We see alot of "noise storms" which spoof tons of IPs, so we also added a check […]

[Original post on mastodon.social]
GreyNoise IP Check results showing malicious activity detected for IP address 89.248.163.216 located in Amsterdam, Netherlands. The IP, owned by IP Volume Inc, has been classified as malicious with observed activity from February 2022 to October 2025. Activity calendars show consistent scanning behavior throughout July, August, September, and October 2025. Tagged activities include Go HTTP Client, Open Proxy Scanner, Recyber Project, SOCKS5 Proxy Scanner, and Web Crawler. A warning banner alerts users that the IP has been observed sending potentially malicious traffic. GreyNoise IP Check results for IP address 34.185.165.52 located in Frankfurt am Main, Germany and owned by Google LLC. A warning banner indicates possible spoofed traffic detection, explaining that the IP may have appeared in scanning activity using spoofed source addresses. The 'Don't Panic!' section clarifies this likely means the IP was used as a fake return address in network scanning, similar to spam email spoofing. Three key points explain: the scanning traffic probably didn't come from this network, attackers may have used the IP as a decoy, and this typically doesn't indicate compromise. Recommended actions include monitoring for unusual outbound traffic, ensuring proper firewall configuration, and contacting the ISP if suspicious activity is noticed. GreyNoise IP Check results for IP address 169.150.198.68 located in São Paulo, Brazil and owned by Datacamp Limited. A blue banner alerts that VPN is detected, noting the results may reflect the VPN provider's IP rather than the actual network. A warning banner states the IP is in the GreyNoise database with 'unknown' classification, indicating it has been observed by GreyNoise sensors scanning the internet. The 'What does this mean?' section explains this could indicate a compromised device or network, misconfigured software making excessive connections, or legitimate security scanning tools. Recommended actions include checking devices for malware, reviewing network activity, contacting the ISP's security team, and considering taking a screenshot for the ISP. An 'Observed Activity In Last 90 Days' section is collapsed.
October 25, 2025 at 4:59 PM
erc-bk.fosstodon.org.ap.brid.gy
Didn't know that {skimr::skim} worked an arrow object. It's pretty cool, but it hits your RAM pretty hard. That's only a 70MB directory of parquet files, and my RAM usage went up by ~1.3GB. #rstats Code: https://ray.so/fCoXwso
NO2 pollution dataset. Schema of the dataset is shown and the descriptive output from skimr::skim. library(arrow) ds <- open_dataset("C:/Users/user/Documents/R/Data/no2/E1a") schema(ds) skimr::skim(ds)
October 14, 2025 at 8:26 PM
Reposted by Eric Book
hrbrmstr.mastodon.social.ap.brid.gy
One other reason I covered Garage (https://dailydrop.hrbrmstr.dev/2025/10/06/drop-714-2025-10-06-monday-morning-grab-bag/) in the 10-06 Drop was b/c we're making super cool new hourly Parquet timeseries now at work & they `aws s3 sync` super fast to my local […]

[Original post on mastodon.social]
R code which can be found at https://ray.so/h2qEAb9
October 13, 2025 at 4:45 PM
Reposted by Eric Book
stephenturner.us
My colleagues and I here at UVA are looking to hire a skilled #Rstats developer. You'll be working with me on the project. Here's the posting: jobs.virginia.edu/us/en/job/R0...
Epidemiologist / Research Data Scientist; Infectious Diseases and International Health in Charlottesville, Virginia, United States of America | Information Management, Services & Technology at Univers...
Apply for Epidemiologist / Research Data Scientist; Infectious Diseases and International Health job with University of Virginia in Charlottesville, Virginia, United States of America. Information Man...
jobs.virginia.edu
October 8, 2025 at 2:17 PM
Reposted by Eric Book
debruine.bsky.social
This fall I will have a blind student in my coding class for the first time. Do any other instructors or visually impaired coders have advice beyond making sure my book has useful alt-text for the images? #rstats #accessibility

Class book: psyteachr.github.io/reprores-v5/
September 16, 2025 at 9:54 AM
Reposted by Eric Book
nowosad.fosstodon.org.ap.brid.gy
🚀 Book in progress: Spatial Data Visualization with tmap

A practical guide to creating clear thematic maps in R with the tmap package.
Covers everything from loading data to interactive and animated maps, with reproducible code and examples.

Read online […]

[Original post on fosstodon.org]
September 14, 2025 at 1:00 PM
Reposted by Eric Book
brembs.mastodon.social.ap.brid.gy
This should have been big news!

Ten funding agencies from eight European countries have pledged to support a public infrastructure that is poised to replace academic journals:
FWF 🇦🇹
RCN 🇳🇴
Forte 🇸🇪
ARIS 🇸🇮
SRC 🇸🇪
FCT 🇵🇹
CSIC 🇪🇸
DFG 🇩🇪
Formas 🇸🇪
ANR 🇫🇷
Only two of them issued press releases in […]
Original post on mastodon.social
mastodon.social
September 3, 2025 at 12:34 PM
Reposted by Eric Book
thomas-sandmann.genomic.social.ap.brid.gy
This week I learned how to manage project-specific R libraries with {rv}, a relatively new, declarative alternative to the well-established {renv} R package: https://tomsing1.github.io/blog/posts/rv/ . {rv} is a command line tool, written in rust, and I really like how it leverages repository […]
Original post on genomic.social
genomic.social
September 2, 2025 at 2:30 PM
Reposted by Eric Book
gmcd.bsky.social
To borrow another example, taken from the `dbreg` README: github.com/grantmcdermo...

Here I am running a fixed-effects regression on 180 million(!) row parquet dataset... and it completes **< 2 seconds**... on my laptop 🤯

This is powered by @duckdb.org under the hood.

#rstats #econsky
Running dbreg::dbreg() on a full year of NYC taxi data... and it takes less than 2 seconds. dbreg( tip_amount ~ fare_amount + passenger_count | month + vendor_name, path = "read_parquet('nyc-taxi/**/*.parquet')", ## path to hive-partitioned dataset vcov = "hc1" ) #> [dbreg] Estimating compression ratio... #> [dbreg] Data has 178,544,324 rows and 24 unique FE groups. #> [dbreg] Using strategy: compress #> [dbreg] Executing compress strategy SQL #> #> Compressed OLS estimation, Dep. Var.: tip_amount #> Observations.: 178,544,324 (original) | 70,782 (compressed) #> Standard Errors: Heteroskedasticity-robust #> Estimate Std. Error t value Pr(>|t|) #> fare_amount 0.106744 0.000068 1564.742 < 2.2e-16 *** #> passenger_count -0.029086 0.000106 -273.866 < 2.2e-16 *** #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
August 25, 2025 at 6:38 PM
Reposted by Eric Book
nowosad.fosstodon.org.ap.brid.gy
🚀 From soil to space (and back) : PhD position using satellites & ML to study peatland carbon flux. Based in Münster, with research stays in Enschede.

📅 Apply before 15 Sept 2025

🔗 https://stellen.uni-muenster.de/jobposting/112b1672862ecf6f36fedb4835a68b8e4b77c78e0

#remotesensing #phd […]
Original post on fosstodon.org
fosstodon.org
August 18, 2025 at 2:02 PM
Reposted by Eric Book
christosargyrop.mast.hpc.social.ap.brid.gy
So, do all #blas functions scale linearly only up to 4-6 threads? This seems to be the case when multithreaded BLAS is used for glm(m) modeling in #rstats
#hpc
August 8, 2025 at 9:55 PM
Reposted by Eric Book
simon.fedi.simonwillison.net.ap.brid.gy
Here's what I mean by "competitively priced"
A table comparing AI model pricing. Columns: Model, Input $/m, Output $/m. Rows: Claude Opus 4 – Input 15.00, Output 75.00; Claude Sonnet 4 – Input 3.00, Output 15.00; Gemini 2.5 Pro (>200,000) – Input 2.50, Output 15.00; GPT-4o – Input 2.50, Output 10.00; GPT-4.1 – Input 2.00, Output 8.00; o3 – Input 2.00, Output 8.00; Gemini 2.5 Pro (<200,000) – Input 1.25, Output 10.00; GPT-5 – Input 1.25, Output 10.00; o4-mini – Input 1.10, Output 4.40; Claude 3.5 Haiku – Input 0.80, Output 4.00; GPT-4.1 mini – Input 0.40, Output 1.60; Gemini 2.5 Flash – Input 0.30, Output 2.50; GPT-5 Mini – Input 0.25, Output 2.00; GPT-4o mini – Input 0.15, Output 0.60; Gemini 2.5 Flash-Lite – Input 0.10, Output 0.40; GPT-4.1 Nano – Input 0.10, Output 0.40; Amazon Nova Lite – Input 0.06, Output 0.24; GPT-5 Nano – Input 0.05, Output 0.40; Amazon Nova Micro – Input 0.035, Output 0.14.
August 7, 2025 at 5:52 PM
Reposted by Eric Book
stephenturner.us
UseR 2025: pkgdocs: a modular R package site generator www.youtube.com/watch?v=pqTW... #Rstats
pkgdocs: a modular R package site generator - Daan Seynaeve
pkgdocs is a new R package to generate package documentation as markdown from an R source package. Compared to other tools, pkgdocs is not focused on generating a static website directly, but rather…
www.youtube.com
August 2, 2025 at 10:22 AM
Reposted by Eric Book
simon.fedi.simonwillison.net.ap.brid.gy
I got an MLX 3bit version of GLM 4.5 Air running on my 64GB Mac and WOW this is an impressive local model! https://simonwillison.net/2025/Jul/29/space-invaders/
My 2.5 year old laptop can write Space Invaders in JavaScript now
I wrote about the new GLM-4.5 model family yesterday—new open weight (MIT licensed) models from Z.ai in China which their benchmarks claim score highly in coding even against models such …
simonwillison.net
July 29, 2025 at 1:09 PM
Reposted by Eric Book
statsepi.bsky.social
You can have all the omni-omics data in the world and the bestest algorithms, but eventually a predicted probability is produced & it should be evaluated using well-established methods, and correctly implemented in the context of medical decision making.

statsepi.substack.com/i/140315566/...
The leaky pipe of clinical prediction models. by @maartenvsmeden.bsky.social‬ et al
July 14, 2025 at 9:49 AM
Reposted by Eric Book
eliocamp.mastodon.social.ap.brid.gy
So now that parallel processing in purrr is officially out I wanted to test mirai on an #hpc. So far, it seems to work relatively painlessly. Just set up your PBS config and mirai::daemons(n) will spin up n jobs.

Now, is it optimal to have number of "workers" = number of jobs? If each job has […]
Original post on mastodon.social
mastodon.social
July 11, 2025 at 1:08 AM