@francescalted.bsky.social
Reposted
November 12, 2025 at 9:13 AM
Reposted
Haha, this from the New Yorker is getting passed around the math dork community. I did a comic about this kind of thought a few years ago: www.smbc-comics.com/comic/commut...
November 7, 2025 at 5:26 PM
Haha, this from the New Yorker is getting passed around the math dork community. I did a comic about this kind of thought a few years ago: www.smbc-comics.com/comic/commut...
Reposted
Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
18.08.2025 Compress, Compute, and Conquer: Python-Blosc2 for Efficient Data Analysis
YouTube video by EuroSciPy
www.youtube.com
November 7, 2025 at 11:38 AM
Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Reposted
📢🚨Blosc2 3.11.0 Released! 🚨 📢
Blosc2 is part of the NumPy array library ecosystem: numpy.org
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:
𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱)
for 𝙰, 𝙱 PyTorch, Jax, Tensorflow, Zarr... arrays!
#Compute
#Tensor
#PyTorch
Blosc2 is part of the NumPy array library ecosystem: numpy.org
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:
𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱)
for 𝙰, 𝙱 PyTorch, Jax, Tensorflow, Zarr... arrays!
#Compute
#Tensor
#PyTorch
November 3, 2025 at 8:30 AM
The importance of linear algebra in modern computing is undeniable 📐.
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
💊IronPill 2💊
See how Blosc2 powers heavy-duty linear algebra (100GB!) workflows
⚡1.5-2x faster than PyTorch + h5py!
🧱 optimised chunking for your cache hierarchy
🐍 one line syntax 𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱, 𝚞𝚛𝚕𝚙𝚊𝚝𝚑='𝚘𝚞𝚝.𝚋𝟸𝚗𝚍')
See blog here: ironarray.io/blog/la-blosc
#Blosc2
#Data
#LinearAlgebra
See how Blosc2 powers heavy-duty linear algebra (100GB!) workflows
⚡1.5-2x faster than PyTorch + h5py!
🧱 optimised chunking for your cache hierarchy
🐍 one line syntax 𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱, 𝚞𝚛𝚕𝚙𝚊𝚝𝚑='𝚘𝚞𝚝.𝚋𝟸𝚗𝚍')
See blog here: ironarray.io/blog/la-blosc
#Blosc2
#Data
#LinearAlgebra
October 28, 2025 at 1:22 PM
The importance of linear algebra in modern computing is undeniable 📐.
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
Reposted
💊 IronPill 1💊
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
October 20, 2025 at 12:06 PM
💊 IronPill 1💊
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
From a programmer's virtue to a computational powerhouse: laziness transforms a developer's best practice into the engine of modern computing.
📢Blosc2 3.10.2 Released! 📢
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
October 15, 2025 at 12:07 PM
From a programmer's virtue to a computational powerhouse: laziness transforms a developer's best practice into the engine of modern computing.
Inspired by the ESA's Gaia Milky Way map 🌌!
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
October 10, 2025 at 9:23 AM
Inspired by the ESA's Gaia Milky Way map 🌌!
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
That's great news! Blosc2 is on its way to become a standard computing engine for most common array containers out there 🚀
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
🚨Blosc2 3.9.1🚨
Blosc2 as a mature computation engine >>>
• Array API standard compliance - 70 new functions
• Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
• Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
Blosc2 as a mature computation engine >>>
• Array API standard compliance - 70 new functions
• Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
• Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
October 1, 2025 at 9:39 AM
That's great news! Blosc2 is on its way to become a standard computing engine for most common array containers out there 🚀
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
🚀 Boost your Python computations on NumPy arrays with @blosc.jit! Let Blosc2's compute engine accelerate your code without changing containers. ⚡
For ultimate speed, native Blosc2 containers are still king. 🏎️
Code: gist.github.com/FrancescAlte...
#Python #DataScience #NumPy #Performance #Blosc
For ultimate speed, native Blosc2 containers are still king. 🏎️
Code: gist.github.com/FrancescAlte...
#Python #DataScience #NumPy #Performance #Blosc
September 22, 2025 at 12:20 PM
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
Reposted
added a cheat sheet to the official Git website https://git-scm.com/cheat-sheet
September 16, 2025 at 6:27 PM
added a cheat sheet to the official Git website https://git-scm.com/cheat-sheet
🎉 Exciting news! Python-Blosc2 is making huge strides towards array-api compliance. 🚀
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
🗣️ Announcing Python-Blosc2 3.8.0 🚀
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
September 12, 2025 at 11:40 AM
🎉 Exciting news! Python-Blosc2 is making huge strides towards array-api compliance. 🚀
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
Reposted
🗣️ Announcing C-Blosc2 2.21.2
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
github.com
September 10, 2025 at 12:16 PM
🗣️ Announcing C-Blosc2 2.21.2
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
LLMs are getting quite good at producing code. But when that last drop of performance counts, it seems our carbon-based predecessors 🧠, armed with good tools and a healthy obsession, still have a few tricks up their sleeves.
Struggling to get performant code from LLMs? 🤔
We can help! 💪 We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).
Ready to dive in? 🚀
🔹 EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
🔹 Tutorial: github.com/Blosc/EuroSc...
#HPC #Blosc2
We can help! 💪 We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).
Ready to dive in? 🚀
🔹 EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
🔹 Tutorial: github.com/Blosc/EuroSc...
#HPC #Blosc2
September 8, 2025 at 12:18 PM
LLMs are getting quite good at producing code. But when that last drop of performance counts, it seems our carbon-based predecessors 🧠, armed with good tools and a healthy obsession, still have a few tricks up their sleeves.
This is exactly the kind of application we envisioned for Blosc2, enabling more efficient and scalable data handling (in this case, image handling).
📣Great to see the community building powerful tools on Blosc2! 🚀
Check out compress-image: a new C++/Python library for working with compressed images directly in memory.
Kudos to Emil Dohne for this fantastic work!
Project here: github.com/EmilDohne/co...
#Blosc2 #FOSS #ImageProcessing
Check out compress-image: a new C++/Python library for working with compressed images directly in memory.
Kudos to Emil Dohne for this fantastic work!
Project here: github.com/EmilDohne/co...
#Blosc2 #FOSS #ImageProcessing
GitHub - EmilDohne/compressed-image: Fast and memory-efficient, compressed in-memory image storage for C++ and Python.
Fast and memory-efficient, compressed in-memory image storage for C++ and Python. - EmilDohne/compressed-image
github.com
September 1, 2025 at 5:34 PM
This is exactly the kind of application we envisioned for Blosc2, enabling more efficient and scalable data handling (in this case, image handling).
Què bé que li vindria això a l'antic mercat del dilluns de Castelló de la Plana (que per cert, encara no sembla que tinga compte en BlueSky).
#Paris has removed the paving from its city hall square and transformed it into an #urbanforest
#urbanism #owgf #solarpunk #climateaction
#urbanism #owgf #solarpunk #climateaction
August 24, 2025 at 6:31 AM
Què bé que li vindria això a l'antic mercat del dilluns de Castelló de la Plana (que per cert, encara no sembla que tinga compte en BlueSky).
Reposted
#Paris has removed the paving from its city hall square and transformed it into an #urbanforest
#urbanism #owgf #solarpunk #climateaction
#urbanism #owgf #solarpunk #climateaction
August 20, 2025 at 10:30 PM
#Paris has removed the paving from its city hall square and transformed it into an #urbanforest
#urbanism #owgf #solarpunk #climateaction
#urbanism #owgf #solarpunk #climateaction
The slides of my talk about _Blosc2: Compress Better, Compute Bigger_ for the recent @euroscipy.bsky.social:
www.blosc.org/docs/2025-Eu...
EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!
www.blosc.org/docs/2025-Eu...
EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!
August 22, 2025 at 3:53 PM
The slides of my talk about _Blosc2: Compress Better, Compute Bigger_ for the recent @euroscipy.bsky.social:
www.blosc.org/docs/2025-Eu...
EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!
www.blosc.org/docs/2025-Eu...
EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!
🚀 I'm also thrilled about the new blosc2.TreeStore class 🚀
We had the opportunity to show it in action during our recent tutorial at #EuroSciPy 2025, where we had a good time seeing audience engagement. Thanks to the attendees!
We had the opportunity to show it in action during our recent tutorial at #EuroSciPy 2025, where we had a good time seeing audience engagement. Thanks to the attendees!
🚀 We're thrilled to announce *TreeStore*, a new class in Python-Blosc2! Endow your datasets with a hierarchical structure! ⚡️
📝 We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
📝 We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
August 20, 2025 at 6:11 AM
🚀 I'm also thrilled about the new blosc2.TreeStore class 🚀
We had the opportunity to show it in action during our recent tutorial at #EuroSciPy 2025, where we had a good time seeing audience engagement. Thanks to the attendees!
We had the opportunity to show it in action during our recent tutorial at #EuroSciPy 2025, where we had a good time seeing audience engagement. Thanks to the attendees!
There's a special joy in deleting code. This Caterva2 release included a huge refactoring effort to shed complexity, resulting in a much cleaner and more robust system. It's one of the most satisfying parts of the job! ✨
📣 #Caterva2 2025.8.7 is out! 🚀
We did a major refactoring for a simpler, more robust system, with client APIs unaffected. ✅
The highlight is the new cat2agent 🤖, a CLI client to watch a directory and auto-sync it with a Caterva2 server.
Release notes: github.com/ironArray/Ca...
#OpenSource
We did a major refactoring for a simpler, more robust system, with client APIs unaffected. ✅
The highlight is the new cat2agent 🤖, a CLI client to watch a directory and auto-sync it with a Caterva2 server.
Release notes: github.com/ironArray/Ca...
#OpenSource
August 7, 2025 at 10:03 AM
There's a special joy in deleting code. This Caterva2 release included a huge refactoring effort to shed complexity, resulting in a much cleaner and more robust system. It's one of the most satisfying parts of the job! ✨
Reposted
Hey fam 👋
In a new blog post, I wrote about my journey from zero to RAG engineer after 1200 hours building enterprise AI.
What actually works vs. what's just hype. Hard-learned lessons so you don't repeat my mistakes 👇
news.ycombinator.com/item?id=4474...
#TechBlog #BuildInPublic #RAG #AI #LLM
In a new blog post, I wrote about my journey from zero to RAG engineer after 1200 hours building enterprise AI.
What actually works vs. what's just hype. Hard-learned lessons so you don't repeat my mistakes 👇
news.ycombinator.com/item?id=4474...
#TechBlog #BuildInPublic #RAG #AI #LLM
From zero to RAG engineer: 1200 hours of lessons so you don't repeat my mistakes | Hacker News
news.ycombinator.com
July 31, 2025 at 8:05 AM
Hey fam 👋
In a new blog post, I wrote about my journey from zero to RAG engineer after 1200 hours building enterprise AI.
What actually works vs. what's just hype. Hard-learned lessons so you don't repeat my mistakes 👇
news.ycombinator.com/item?id=4474...
#TechBlog #BuildInPublic #RAG #AI #LLM
In a new blog post, I wrote about my journey from zero to RAG engineer after 1200 hours building enterprise AI.
What actually works vs. what's just hype. Hard-learned lessons so you don't repeat my mistakes 👇
news.ycombinator.com/item?id=4474...
#TechBlog #BuildInPublic #RAG #AI #LLM
While we've poured lots of ❤️ into #Blosc2 internal algorithms, every use case is unique. No worries! You can always tweak the internal knobs to get the best performance for your needs 💪
Python-Blosc2 comes with an extensively tested partition sizes algorithm for automatically setting the best chunk and block sizes for you.
But you can always bypass this mechanism for more appropriate fine-tuning in different scenarios 🚀
www.blosc.org/python-blosc...
#Compression #Performance
But you can always bypass this mechanism for more appropriate fine-tuning in different scenarios 🚀
www.blosc.org/python-blosc...
#Compression #Performance
July 29, 2025 at 8:45 AM
While we've poured lots of ❤️ into #Blosc2 internal algorithms, every use case is unique. No worries! You can always tweak the internal knobs to get the best performance for your needs 💪
Reposted
If you believe all human beings are created b’tzelem Elohim, in God’s image, then you must speak up now against the daily atrocities in Gaza.
www.haaretz.com/opinion/2025...
www.haaretz.com/opinion/2025...
In the not-so-distant future, Israel will have to reckon with its war crimes in Gaza | Opinion
***
www.haaretz.com
July 24, 2025 at 10:04 PM
If you believe all human beings are created b’tzelem Elohim, in God’s image, then you must speak up now against the daily atrocities in Gaza.
www.haaretz.com/opinion/2025...
www.haaretz.com/opinion/2025...
Hats off to the excellent work that @lshaw-ironarray.bsky.social is doing to the @ironarray.io and @blosc.org ecosystems.
Fancy indexing is like a wild animal difficult to tame, but in this particular case he did an outstanding work at it! 👏
Fancy indexing is like a wild animal difficult to tame, but in this particular case he did an outstanding work at it! 👏
🗣️ Announcing Python-Blosc2 3.6.1
¡Unlock new levels of data manipulation with #Blosc2! 🚀
We've tamed the complexity of fancy indexing to make it intuitive, efficient, and consistent with NumPy's behavior.
👉 www.blosc.org/posts/blosc2...
Enjoy
#Python #DataScience #BigData #NumPy #Performance
¡Unlock new levels of data manipulation with #Blosc2! 🚀
We've tamed the complexity of fancy indexing to make it intuitive, efficient, and consistent with NumPy's behavior.
👉 www.blosc.org/posts/blosc2...
Enjoy
#Python #DataScience #BigData #NumPy #Performance
July 18, 2025 at 9:34 AM
Hats off to the excellent work that @lshaw-ironarray.bsky.social is doing to the @ironarray.io and @blosc.org ecosystems.
Fancy indexing is like a wild animal difficult to tame, but in this particular case he did an outstanding work at it! 👏
Fancy indexing is like a wild animal difficult to tame, but in this particular case he did an outstanding work at it! 👏
Undergoing endless guesswork to find the best compression parameters? 🤔 Let Btune do the heavy lifting! 🚀✨
Tired of trial-and-error with #Blosc2 compression?
You can do better with #Btune! 🚀
Btune can be trained to automatically find the best parameters for your specific datasets and use case.
Learn more about optimizing your compression workflow: ironarray.io/btune
#DataCompression #Optimization
You can do better with #Btune! 🚀
Btune can be trained to automatically find the best parameters for your specific datasets and use case.
Learn more about optimizing your compression workflow: ironarray.io/btune
#DataCompression #Optimization
July 16, 2025 at 12:26 PM
Undergoing endless guesswork to find the best compression parameters? 🤔 Let Btune do the heavy lifting! 🚀✨