Dewey Dunnington
@paleolimbot.bsky.social
Scaling spatial computing at Wherobots, Inc. ApacheArrow PMC, #gischat, #rstats, ex Voltron Data.
Reposted by Dewey Dunnington
Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...
Duck Hunt: moving Bauplan from DuckDB to DataFusion
Bauplan's journey from DuckDB to Apache DataFusion: how switching SQL engines doubled query performance on Iceberg lakehouses while enabling greater hackability
www.bauplanlabs.com
November 11, 2025 at 3:41 PM
Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...
Reposted by Dewey Dunnington
Apache Arrow 22.0.0 is now available for download: buff.ly/rFyGsDV
This release includes 213 resolved issues. #opensource
This release includes 213 resolved issues. #opensource
November 9, 2025 at 8:01 PM
Apache Arrow 22.0.0 is now available for download: buff.ly/rFyGsDV
This release includes 213 resolved issues. #opensource
This release includes 213 resolved issues. #opensource
Reposted by Dewey Dunnington
This @posit.co::conf(2025) talk is everything: "The geospatial suite for Arrow is relatively new...so this is a PSA that it exists and it's really powerful and impressive. I actually also found it very easy to use...and I didn't really have much trouble learning it" www.youtube.com/watch?v=EHyg...
Make Big Geospatial Data Accessible with Arrow (Cari Gostic, Sonoma Technology) | posit::conf(2025)
YouTube video by Posit PBC
www.youtube.com
November 7, 2025 at 10:49 PM
This @posit.co::conf(2025) talk is everything: "The geospatial suite for Arrow is relatively new...so this is a PSA that it exists and it's really powerful and impressive. I actually also found it very easy to use...and I didn't really have much trouble learning it" www.youtube.com/watch?v=EHyg...
Reposted by Dewey Dunnington
RE: https://fosstodon.org/@underdarkGIS/113300727609804149
Over 250 #geospatial #gischat counts to follow: https://gist.github.com/anitagraser/a37118d74b839602e0f474375f548dfd
Over 250 #geospatial #gischat counts to follow: https://gist.github.com/anitagraser/a37118d74b839602e0f474375f548dfd
Are you new to the #fediverse #gischat or looking for more #geospatial connections?
I've updated my Geospatial and #SpatialDataScience lists. Now with more than 200 accounts you shouldn't miss.
Details: https://anitagraser.com/2024/02/03/finding-geospatial-accounts-on-mastodon/
#osgeo #gis […]
I've updated my Geospatial and #SpatialDataScience lists. Now with more than 200 accounts you shouldn't miss.
Details: https://anitagraser.com/2024/02/03/finding-geospatial-accounts-on-mastodon/
#osgeo #gis […]
Original post on fosstodon.org
fosstodon.org
November 7, 2025 at 10:09 PM
Day 6 of the #30DayMapChallenege is Dimensions! Here I create a beautiful space-time dataset with M values and a proper temporal CRS with SedonaDB...and then ignore it because I couldn't find a tool that can animate M values (let me know if there is one!). dewey.dunnington.ca/post/2025/da...
November 7, 2025 at 3:20 PM
Day 6 of the #30DayMapChallenege is Dimensions! Here I create a beautiful space-time dataset with M values and a proper temporal CRS with SedonaDB...and then ignore it because I couldn't find a tool that can animate M values (let me know if there is one!). dewey.dunnington.ca/post/2025/da...
Day 5 of the #30DayMapChallenege! In which I attempt simple LiDAR processing for the first time using SedonaDB. Behold...a high-resolution elevation map of what's under my feet in my hometown of Winnipeg, Manitoba. Code + walk through included! dewey.dunnington.ca/post/2025/da...
November 6, 2025 at 3:02 PM
Day 5 of the #30DayMapChallenege! In which I attempt simple LiDAR processing for the first time using SedonaDB. Behold...a high-resolution elevation map of what's under my feet in my hometown of Winnipeg, Manitoba. Code + walk through included! dewey.dunnington.ca/post/2025/da...
Excited to be one of the attendees and present our work on the DataFusion-powered SedonaDB alongside a great lineup of talks! If you're in the Boston area come and say hi!
We are holding the next Apache DataFusion meetup next Wednesday Nov 12 in Boston. lu.ma/w9pw5rce
Boston Apache DataFusion Meetup · Luma
Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. This…
lu.ma
November 4, 2025 at 6:33 PM
Excited to be one of the attendees and present our work on the DataFusion-powered SedonaDB alongside a great lineup of talks! If you're in the Boston area come and say hi!
#30DayMapChallenge day three is polygons...here's a map I made for my Ph.D. thesis...a standard Fig 1 for lakes papers. This paper is about land use and how it is resolved in sediment, so I tried to communicate urban development in each catchment using very thin roads. This one is 100% QGIS!
November 3, 2025 at 3:22 PM
#30DayMapChallenge day three is polygons...here's a map I made for my Ph.D. thesis...a standard Fig 1 for lakes papers. This paper is about land use and how it is resolved in sediment, so I tried to communicate urban development in each catchment using very thin roads. This one is 100% QGIS!
#30DayMapChallenege day two is lines! Here's an animated version of the stream traversal with SedonaDB post I made a few weeks ago but using the Gaspereau River, which drains Gaspereau Lake (featured in day one). dewey.dunnington.ca/post/2025/da...
November 2, 2025 at 1:43 PM
#30DayMapChallenege day two is lines! Here's an animated version of the stream traversal with SedonaDB post I made a few weeks ago but using the Gaspereau River, which drains Gaspereau Lake (featured in day one). dewey.dunnington.ca/post/2025/da...
Day 1 of the #30DayMapChallenege is points! This one is entitled "Always Plot Your Test Data"...I've been using data called ns-water_point for a long time without properly inspecting it. It turns out the points are almost all rocks! They're pretty much all rocks. dewey.dunnington.ca/post/2025/da...
November 1, 2025 at 2:58 PM
Day 1 of the #30DayMapChallenege is points! This one is entitled "Always Plot Your Test Data"...I've been using data called ns-water_point for a long time without properly inspecting it. It turns out the points are almost all rocks! They're pretty much all rocks. dewey.dunnington.ca/post/2025/da...
Reposted by Dewey Dunnington
GeoArrow is undoubtedly a superior format to GeoJSON, yet GeoJSON remains the dominant standard in web browsers. I'm hoping we'll reach a point where using GeoArrow is just as easy and seamless as using GeoJSON. I hope my talk helps to figure out what's still missing in the ecosystem.
November 1, 2025 at 11:55 AM
GeoArrow is undoubtedly a superior format to GeoJSON, yet GeoJSON remains the dominant standard in web browsers. I'm hoping we'll reach a point where using GeoArrow is just as easy and seamless as using GeoJSON. I hope my talk helps to figure out what's still missing in the ecosystem.
Reposted by Dewey Dunnington
#30DayMapChallenge starts tomorrow: 30 days, 30 map ideas.
If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭
30daymapchallenge.com
#GeoData #DataViz #Maps #SpatialViz
If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭
30daymapchallenge.com
#GeoData #DataViz #Maps #SpatialViz
30DayMapChallenge
Daily mapping challenge happening every November!
30daymapchallenge.com
October 31, 2025 at 3:02 PM
#30DayMapChallenge starts tomorrow: 30 days, 30 map ideas.
If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭
30daymapchallenge.com
#GeoData #DataViz #Maps #SpatialViz
If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭
30daymapchallenge.com
#GeoData #DataViz #Maps #SpatialViz
Reposted by Dewey Dunnington
New version of Rust Apache Arrow and Apache Parquet is out -- includes new new metadata parser, new avro reader, geometry and variant support 🤯 arrow.apache.org/blog/2025/10...
Apache Arrow Rust 57.0.0 Release
The Apache Arrow team is pleased to announce that the v57.0.0 release of Apache Arrow Rust is now available on crates.io (arrow and parquet) and as source download. See the 57.0.0 changelog for a full...
arrow.apache.org
October 31, 2025 at 10:26 AM
New version of Rust Apache Arrow and Apache Parquet is out -- includes new new metadata parser, new avro reader, geometry and variant support 🤯 arrow.apache.org/blog/2025/10...
Reposted by Dewey Dunnington
We're cooking up a lot of great stuff, check out our announcement to learn more. I've been really lucky to get to work on Arrow the last few years and even luckier to get to keep doing that!
The future of data connectivity is columnar. Today we launched
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
Announcing Columnar
Back to the future of data connectivity
columnar.tech
October 30, 2025 at 12:08 AM
We're cooking up a lot of great stuff, check out our announcement to learn more. I've been really lucky to get to work on Arrow the last few years and even luckier to get to keep doing that!
Reposted by Dewey Dunnington
We made Apache Parquet metadata parsing 3x-9x faster in the latest release of the Rust implementation
arrow.apache.org/blog/2025/10...
arrow.apache.org/blog/2025/10...
October 24, 2025 at 9:55 AM
We made Apache Parquet metadata parsing 3x-9x faster in the latest release of the Rust implementation
arrow.apache.org/blog/2025/10...
arrow.apache.org/blog/2025/10...
Reposted by Dewey Dunnington
Absolutely wonderful from @vickiboykis.com - newsletter.vickiboykis.com/archive/i-wa...
I want to see the claw
I respect quality software and the people who write it. And, I’ve invested years of my life in working on becoming one of these people (even if the journey...
newsletter.vickiboykis.com
October 22, 2025 at 11:19 AM
Absolutely wonderful from @vickiboykis.com - newsletter.vickiboykis.com/archive/i-wa...
This week's Apache Sedona drop: lazy/selective GeoParquet reads in SedonaDB, @duckdb.org, GDAL, and GeoPandas! This is how querying a GeoParquet file plonked on a web server can be queried locally (and why GeoParquet can be even faster locally!) dewey.dunnington.ca/post/2025/la... #gischat
Lazy GeoParquet reading in SedonaDB, DuckDB, GeoPandas, and GDAL | Dewey Dunnington
I’m an obvious fan of GeoParquet and SedonaDB and it should be no surprise that I worked (still working!) pretty hard making sure SedonaDB could take advantage of all GeoParquet had to offer.
dewey.dunnington.ca
October 16, 2025 at 2:59 PM
This week's Apache Sedona drop: lazy/selective GeoParquet reads in SedonaDB, @duckdb.org, GDAL, and GeoPandas! This is how querying a GeoParquet file plonked on a web server can be queried locally (and why GeoParquet can be even faster locally!) dewey.dunnington.ca/post/2025/la... #gischat
This in turn was due to @yutannihilation-en.bsky.social's fantastic work on Savvy (lightweight R bindings for Rust)!
Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats
apache.r-universe.dev/sedonadb
apache.r-universe.dev/sedonadb
sedonadb: Bindings for Apache SedonaDB
apache.r-universe.dev
October 11, 2025 at 5:09 PM
This in turn was due to @yutannihilation-en.bsky.social's fantastic work on Savvy (lightweight R bindings for Rust)!
Reposted by Dewey Dunnington
Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats
apache.r-universe.dev/sedonadb
apache.r-universe.dev/sedonadb
sedonadb: Bindings for Apache SedonaDB
apache.r-universe.dev
October 11, 2025 at 5:02 PM
Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats
apache.r-universe.dev/sedonadb
apache.r-universe.dev/sedonadb
Reposted by Dewey Dunnington
Our new thrift parser in the Rust Apache Parquet implementation is a 🎁 that keeps on giving performance wise 🚀 github.com/apache/arrow...
We are also working on a blog post that has a deeper explanation
We are also working on a blog post that has a deeper explanation
October 10, 2025 at 6:52 PM
Our new thrift parser in the Rust Apache Parquet implementation is a 🎁 that keeps on giving performance wise 🚀 github.com/apache/arrow...
We are also working on a blog post that has a deeper explanation
We are also working on a blog post that has a deeper explanation
Well deserved!
I'm happy to announce I've been promoted to an Apache Arrow Committer, meaning I'm authorized to merge code patches into Arrow repositories!
I join this list of amazing people: arrow.apache.org/committers/
I join this list of amazing people: arrow.apache.org/committers/
Committers
List of project-management committee (PMC) members and committers on the Apache Arrow project.
arrow.apache.org
October 9, 2025 at 6:42 PM
Well deserved!
Reposted by Dewey Dunnington
Yesterday I learned about the SpatialBench from Sedona github.com/apache/sedon...
Which they based on the tpchgen-rs project from @clflushopt.bsky.social github.com/clflushopt/t...
(BTW I a still looking for some more github watchers on tpchgen-rs so I can get it on homebrew)
Which they based on the tpchgen-rs project from @clflushopt.bsky.social github.com/clflushopt/t...
(BTW I a still looking for some more github watchers on tpchgen-rs so I can get it on homebrew)
October 9, 2025 at 5:38 PM
Yesterday I learned about the SpatialBench from Sedona github.com/apache/sedon...
Which they based on the tpchgen-rs project from @clflushopt.bsky.social github.com/clflushopt/t...
(BTW I a still looking for some more github watchers on tpchgen-rs so I can get it on homebrew)
Which they based on the tpchgen-rs project from @clflushopt.bsky.social github.com/clflushopt/t...
(BTW I a still looking for some more github watchers on tpchgen-rs so I can get it on homebrew)
I'm aiming for a weekly Apache Sedona drop...this week's edition: wrangling some uncooperative input data into GeoParquet output using SedonaDB's excellent @arrow.apache.org interop. Bonus: learn about the postage stamps of farm field dotting the prairies!
dewey.dunnington.ca/post/2025/ge...
dewey.dunnington.ca/post/2025/ge...
(Geo)Data cleaning with Arrow and SedonaDB | Dewey Dunnington
Last week I had the pleasure of being a guest on a Cloud Native Geospatial webinar with my colleagues Jia Yu and Matt Forrest where we talked SedonaDB. In the webinar Matt demoed a fantastic blog post...
dewey.dunnington.ca
October 7, 2025 at 4:45 PM
I'm aiming for a weekly Apache Sedona drop...this week's edition: wrangling some uncooperative input data into GeoParquet output using SedonaDB's excellent @arrow.apache.org interop. Bonus: learn about the postage stamps of farm field dotting the prairies!
dewey.dunnington.ca/post/2025/ge...
dewey.dunnington.ca/post/2025/ge...
Reposted by Dewey Dunnington
Great news for Arrow (and more work for us 😄).
Also, those work items also implicitly apply to #ApacheParquet. @julien.ledem.net
Also, those work items also implicitly apply to #ApacheParquet. @julien.ledem.net
The Sovereign Tech Agency backs Apache Arrow's Future with QuantStack!
This funding will empower Arrow maintainers at QuantStack, @pitrou.net and @raulcumplido.bsky.social, to advance security, modularity, and long-term sustainability of @arrow.apache.org.
medium.com/@QuantStack/...
This funding will empower Arrow maintainers at QuantStack, @pitrou.net and @raulcumplido.bsky.social, to advance security, modularity, and long-term sustainability of @arrow.apache.org.
medium.com/@QuantStack/...
The Sovereign Tech Agency Invests in Apache Arrow’s Future with QuantStack
We are thrilled to announce that the Sovereign Tech Fund is providing critical funding to sustain and improve Apache Arrow, an essential…
medium.com
October 7, 2025 at 12:35 PM
Great news for Arrow (and more work for us 😄).
Also, those work items also implicitly apply to #ApacheParquet. @julien.ledem.net
Also, those work items also implicitly apply to #ApacheParquet. @julien.ledem.net
Reposted by Dewey Dunnington
New blog post! kylebarron.dev/blog/fast-py...
This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!
This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!
October 7, 2025 at 2:05 PM
New blog post! kylebarron.dev/blog/fast-py...
This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!
This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!