Zarr
@zarr.dev
Pinned
Zarr
Have beautiful data in Zarr? Show us on Bluesky!
zarr.dev
Your friendly neighborhood #chunked, #compressed, & #cloud-ready #n-dimensional array format is now verified as @zarr.dev on @bsky.app!
Visit us at zarr.dev for more info!
Visit us at zarr.dev for more info!
Reposted by Zarr
Anndata now supports @zarr.dev v3, great for both performance and interoperability. Check out our guide for more info, especially sharding: anndata.readthedocs.io/en/stable/tu.... Don’t worry though, we remain fully v2 backwards compatible - upgrade fearlessly!
August 11, 2025 at 4:51 PM
Anndata now supports @zarr.dev v3, great for both performance and interoperability. Check out our guide for more info, especially sharding: anndata.readthedocs.io/en/stable/tu.... Don’t worry though, we remain fully v2 backwards compatible - upgrade fearlessly!
Reposted by Zarr
♻️ 7/8 - Webinar: Reusable Deep Learning with EOPF Zarr Samples - ESA Copernicus Earth Observation Processor Framework
Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).
#datascience #deeplearning
Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).
#datascience #deeplearning
Welcome! You are invited to join a webinar: Reusable Deep Learning with EOPF Zarr Samples. After registering, you will receive a confirmation email about joining the webinar.
The aim of this webinar is to demonstrate how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE) with the data and tools provi...
us02web.zoom.us
July 7, 2025 at 3:39 PM
♻️ 7/8 - Webinar: Reusable Deep Learning with EOPF Zarr Samples - ESA Copernicus Earth Observation Processor Framework
Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).
#datascience #deeplearning
Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).
#datascience #deeplearning
Reposted by Zarr
I've been waiting a few years for this: Zarr v2 support was just launched in Google Earth Engine! Check out this demo that loads ARCO-ERA5 into GEE 🔥
code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...
code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...
June 27, 2025 at 7:28 PM
I've been waiting a few years for this: Zarr v2 support was just launched in Google Earth Engine! Check out this demo that loads ARCO-ERA5 into GEE 🔥
code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...
code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...
Reposted by Zarr
If you missed today's presentation at the LPS by @thejeran.bsky.social on Browzarr, a browser-based visualization toolkit for exploring and analyzing Zarr data stores, go and check out the version online, and open issues and do feature requests on GitHub. github.com/EarthyScienc...
June 24, 2025 at 2:51 PM
If you missed today's presentation at the LPS by @thejeran.bsky.social on Browzarr, a browser-based visualization toolkit for exploring and analyzing Zarr data stores, go and check out the version online, and open issues and do feature requests on GitHub. github.com/EarthyScienc...
Reposted by Zarr
doodles of two Tree of Life department speakers @sangerinstitute.bsky.social this week, Evgeny Zakharov talking about insanely large scale barcode sequencing and Jerome Kelleher talking about large scale human genomic data analysis.
that's a lot of data 🧬📄
that's a lot of data 🧬📄
June 18, 2025 at 2:14 PM
doodles of two Tree of Life department speakers @sangerinstitute.bsky.social this week, Evgeny Zakharov talking about insanely large scale barcode sequencing and Jerome Kelleher talking about large scale human genomic data analysis.
that's a lot of data 🧬📄
that's a lot of data 🧬📄
Reposted by Zarr
We welcome a new project to OpenSustain.tech #climate #sustainability #opensource #opensustain #openscience github.com/zarr-develop...
GitHub - zarr-developers/zarr-python: An implementation of chunked, compressed, N-dimensional arrays for Python.
An implementation of chunked, compressed, N-dimensional arrays for Python. - zarr-developers/zarr-python
github.com
June 9, 2025 at 7:28 AM
We welcome a new project to OpenSustain.tech #climate #sustainability #opensource #opensustain #openscience github.com/zarr-develop...
ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩
doi.org/10.1093/giga...
doi.org/10.1093/giga...
Analysis-ready VCF at Biobank scale using Zarr
AbstractBackground. Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics.
doi.org
June 11, 2025 at 12:20 PM
ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩
doi.org/10.1093/giga...
doi.org/10.1093/giga...
Reposted by Zarr
Reposted by Zarr
"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."
4/ The Earthmover team is proud to play a leading role in the Zarr project as this community grows.
Read about our takeaways from CNG here: earthmover.io/blog/zarr-ta...
Read about our takeaways from CNG here: earthmover.io/blog/zarr-ta...
Zarr takes Cloud-Native Geospatial by storm - Earthmover
Our takeaways from the Cloud-Native Geospatial conference on Zarr’s surging adoption and its impact on the future of Earth Observation data. Our team just returned from an action-packed week at the Cl...
earthmover.io
May 19, 2025 at 2:38 PM
"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."
Reposted by Zarr
1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.
May 7, 2025 at 3:23 PM
1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.
Reposted by Zarr
Curious about climate patterns? The new ERA Explorer app lets you compare 85 years of climate data worldwide. Analyse climatological averages at any map point or explore month-by-month data.Dive deeper with ERA Explorer! era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S #beautifuldata
#C3S #beautifuldata
March 18, 2025 at 11:34 AM
Curious about climate patterns? The new ERA Explorer app lets you compare 85 years of climate data worldwide. Analyse climatological averages at any map point or explore month-by-month data.Dive deeper with ERA Explorer! era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S #beautifuldata
#C3S #beautifuldata
🧠 Interested in extending #Zarr?
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
ZEP10: Generic extensions (v3.2 spec changes) by joshmoore · Pull Request #344 · zarr-developers/zarr-specs
This is the implementation of ZEP10 which introduces a generic extensions object.
☝🏽 👉🏽 Rendered ZEP10 page: https://zeps--67.org.readthedocs.build/en/67/draft/ZEP0010.html
🗓️ Proposed...
github.com
May 16, 2025 at 3:05 PM
🧠 Interested in extending #Zarr?
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
Reposted by Zarr
Just back from #CNG2025, I wrote up some thoughts on the traction the @zarr.dev format is gaining in the broader geospatial industry (specifically Earth Observation). I also summarize what features and tools the user and developer communities are asking for to fully leverage Zarr. 👇👇👇
1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.
May 7, 2025 at 3:58 PM
Reposted by Zarr
1/ 💡 Our latest blog post in the fundamentals series, written by @tegnicholas.bsky.social, demystifies cloud-optimized scientific data formats!
Read more: earthmover.io/blog/fundame...
Read more: earthmover.io/blog/fundame...
Fundamentals: What is Cloud-Optimized Scientific Data?
What cloud-optimized data really means, and how Zarr and Icechunk enable fast access to massive scientific datasets in cloud object storage.
earthmover.io
April 17, 2025 at 5:21 PM
1/ 💡 Our latest blog post in the fundamentals series, written by @tegnicholas.bsky.social, demystifies cloud-optimized scientific data formats!
Read more: earthmover.io/blog/fundame...
Read more: earthmover.io/blog/fundame...
Reposted by Zarr
🚀 Big launch today: introducing Flux — a game-changing way to serve geospatial data via standard APIs in seconds. Built for scale, speed, and simplicity.
1/ Today we are launching Flux, a powerful new addition to the Earthmover platform. Flux is a high-performance gateway for exploring, querying, and visualizing geospatial data via standards-compliant APIs (EDR, WMS, and OPeNDAP).
April 16, 2025 at 3:10 PM
🚀 Big launch today: introducing Flux — a game-changing way to serve geospatial data via standard APIs in seconds. Built for scale, speed, and simplicity.
Reposted by Zarr
This one was a lot of fun to work on! Why @xarray.bsky.social and @zarr.dev are faster than DuckDB and Parquet for gridded data...from first principles.
⭐ We just released the first post in our Fundamentals series. This one is called 𝐓𝐞𝐧𝐬𝐨𝐫𝐬 𝐯𝐬. 𝐓𝐚𝐛𝐥𝐞𝐬 - 𝐖𝐡𝐲 𝐭𝐚𝐛𝐮𝐥𝐚𝐫 𝐭𝐨𝐨𝐥𝐬 𝐭𝐫𝐢𝐩 𝐨𝐯𝐞𝐫 𝐠𝐫𝐢𝐝𝐝𝐞𝐝 𝐝𝐚𝐭𝐚. earthmover.io/blog/tensors...
Fundamentals: Tensors vs. Tables | Earthmover
Why tabular tools trip over gridded data.
earthmover.io
April 3, 2025 at 6:05 PM
This one was a lot of fun to work on! Why @xarray.bsky.social and @zarr.dev are faster than DuckDB and Parquet for gridded data...from first principles.
Reposted by Zarr
What's behind ERA Explorer's speed? Meet the ZARR archive! 🚀 ZARR revolutionises data processing, enabling fast, efficient access to over 80 years of climate data.
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S @zarr.dev #beautifuldata
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S @zarr.dev #beautifuldata
March 20, 2025 at 12:57 PM
What's behind ERA Explorer's speed? Meet the ZARR archive! 🚀 ZARR revolutionises data processing, enabling fast, efficient access to over 80 years of climate data.
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S @zarr.dev #beautifuldata
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S @zarr.dev #beautifuldata
Reposted by Zarr
Just started using Zarr - literally unbelievably good.
Your friendly neighborhood #chunked, #compressed, & #cloud-ready #n-dimensional array format is now verified as @zarr.dev on @bsky.app!
Visit us at zarr.dev for more info!
Visit us at zarr.dev for more info!
Zarr
Have beautiful data in Zarr? Show us on Bluesky!
zarr.dev
March 24, 2025 at 1:59 PM
Just started using Zarr - literally unbelievably good.
🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "
🚨 New blog post 🚨
In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.
In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.
1/ 🚀 Solving #NASA ’s cloud data dilemma: Icechunk unlocks 100x faster access to archival data formats
We're thrilled to publish results from our pilot project with NASA and @developmentseed.org to enable high-performance cloud-native access for NASA’s 100s of petabytes of Earth observation data.
We're thrilled to publish results from our pilot project with NASA and @developmentseed.org to enable high-performance cloud-native access for NASA’s 100s of petabytes of Earth observation data.
March 29, 2025 at 1:50 PM
🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "
Reposted by Zarr
🚨 New blog post 🚨
In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.
In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.
1/ 🚀 Solving #NASA ’s cloud data dilemma: Icechunk unlocks 100x faster access to archival data formats
We're thrilled to publish results from our pilot project with NASA and @developmentseed.org to enable high-performance cloud-native access for NASA’s 100s of petabytes of Earth observation data.
We're thrilled to publish results from our pilot project with NASA and @developmentseed.org to enable high-performance cloud-native access for NASA’s 100s of petabytes of Earth observation data.
March 28, 2025 at 3:30 PM
Reposted by Zarr
ICYMI: A MATLAB implementation of @zarr.dev has dropped from @mathworks.bsky.social 🚀
github.com/mathworks/MA...
github.com/mathworks/MA...
GitHub - mathworks/MATLAB-support-for-Zarr-files: This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which...
This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which is optimized for cloud storage and parallel co...
github.com
March 18, 2025 at 10:41 PM
ICYMI: A MATLAB implementation of @zarr.dev has dropped from @mathworks.bsky.social 🚀
github.com/mathworks/MA...
github.com/mathworks/MA...
Reposted by Zarr
Really cool new neuroscience benchmark just dropped.
Data is in @zarr.dev and demos use tensorstore.
zapbench-release.storage.googleapis.com/landing.html
Data is in @zarr.dev and demos use tensorstore.
zapbench-release.storage.googleapis.com/landing.html
ZAPBench
ZAPBench evaluates how well different models can predict the activity of over 70,000 neurons in a novel larval zebrafish dataset.
zapbench-release.storage.googleapis.com
March 7, 2025 at 4:25 AM
Really cool new neuroscience benchmark just dropped.
Data is in @zarr.dev and demos use tensorstore.
zapbench-release.storage.googleapis.com/landing.html
Data is in @zarr.dev and demos use tensorstore.
zapbench-release.storage.googleapis.com/landing.html
Reposted by Zarr
Very happy to announce our winter release of syGlass: 2.2.0!
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...
January 14, 2025 at 4:49 PM
Very happy to announce our winter release of syGlass: 2.2.0!
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...
Reposted by Zarr
You, yes you, can help the Cloud Native Geospatial Movement!
Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?
Learn how to give back in my post: cholmes.medium.com/you-yes-you-...
Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?
Learn how to give back in my post: cholmes.medium.com/you-yes-you-...
You, yes you, can help the Cloud Native Geospatial Movement!
Have you benefitted from COG’s, STAC, Zarr, COPC or GeoParquet? Join us in Utah for the first CNG Conference and help just by attending.
cholmes.medium.com
February 10, 2025 at 10:00 PM
You, yes you, can help the Cloud Native Geospatial Movement!
Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?
Learn how to give back in my post: cholmes.medium.com/you-yes-you-...
Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?
Learn how to give back in my post: cholmes.medium.com/you-yes-you-...
Reposted by Zarr
We're a bit late to the bsky game so we appreciate a boost! @loicaroyer.bsky.social @haesleinhuepf.bsky.social @florianjug.bsky.social @lhinderling.bsky.social @kbias.bsky.social @zarr.dev @xarray.bsky.social @scipyconf.bsky.social @drlachie.bsky.social @henriqueslab.bsky.social @globias.bsky.social
February 12, 2025 at 1:44 AM
We're a bit late to the bsky game so we appreciate a boost! @loicaroyer.bsky.social @haesleinhuepf.bsky.social @florianjug.bsky.social @lhinderling.bsky.social @kbias.bsky.social @zarr.dev @xarray.bsky.social @scipyconf.bsky.social @drlachie.bsky.social @henriqueslab.bsky.social @globias.bsky.social