@davidibanez.bsky.social
Reposted
Happy to sponsor such an excellent work!
Is it possible to compute with arrays that are 100x larger than memory and still achieve good performance? 🤯
With the new compute engine in Python-Blosc2, you can! 😊 Check out our blog post for more details: ironarray.io/blog/compute...
Compress Better, Compute Bigger!
With the new compute engine in Python-Blosc2, you can! 😊 Check out our blog post for more details: ironarray.io/blog/compute...
Compress Better, Compute Bigger!
March 12, 2025 at 1:25 PM
Happy to sponsor such an excellent work!
Reposted
🗣️ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🤟
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
April 2, 2025 at 4:06 PM
🗣️ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🤟
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
Reposted
🚀 Blosc2 is blasting groundbreaking compression and computing power straight to the cloud! 🔥💡
🗣️ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🤟
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
April 2, 2025 at 5:06 PM
🚀 Blosc2 is blasting groundbreaking compression and computing power straight to the cloud! 🔥💡
Reposted
It has been a long journey, and our vision is finally taking shape! 🥳
🗣️ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🤟
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
- 🗜️ Access to the best compression algorithms available
- 🔄 Share complex data securely and effortlessly
- ⚡ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
April 2, 2025 at 4:10 PM
It has been a long journey, and our vision is finally taking shape! 🥳
Reposted
This is what happens when software squeezes most of the performance out of contemporary CPUs ⚡⚡
📢 🔥 Article on Blosc2: Compute with TB-sized datasets on your own hardware!
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
March 28, 2025 at 1:50 PM
This is what happens when software squeezes most of the performance out of contemporary CPUs ⚡⚡
Reposted
📢 🔥 Article on Blosc2: Compute with TB-sized datasets on your own hardware!
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
March 28, 2025 at 1:48 PM
📢 🔥 Article on Blosc2: Compute with TB-sized datasets on your own hardware!
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
Reposted
#NumPy has amazing capabilities to interact with the ecosystem, and it shows...
🔥 Blosc2 3.2.1: NumPy's best friend! 🔥 blosc2.jit + NumPy array interface = blazing fast, direct compressed data crunching!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
March 26, 2025 at 6:06 PM
#NumPy has amazing capabilities to interact with the ecosystem, and it shows...
Reposted
🔥 Blosc2 3.2.1: NumPy's best friend! 🔥 blosc2.jit + NumPy array interface = blazing fast, direct compressed data crunching!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
March 26, 2025 at 6:04 PM
🔥 Blosc2 3.2.1: NumPy's best friend! 🔥 blosc2.jit + NumPy array interface = blazing fast, direct compressed data crunching!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
Reposted
Since the arrival of AI coding tools, getting matplotlib right starts to be pleasant again. The plot below just took 20 min to look this nice (even surpassing my expectations) 😀
March 26, 2025 at 10:27 AM
Since the arrival of AI coding tools, getting matplotlib right starts to be pleasant again. The plot below just took 20 min to look this nice (even surpassing my expectations) 😀
Reposted
🗣️ C-Blosc2 2.16.0 is out. We have added new features, like:
* _fseeki64/_ftelli64/_stat64 on Windows for large file support.
* 12-byte unshuffle for avx2 and sse2.
* Better description of the Blosc2 format as a whole.
Compress better, Compute faster!
* _fseeki64/_ftelli64/_stat64 on Windows for large file support.
* 12-byte unshuffle for avx2 and sse2.
* Better description of the Blosc2 format as a whole.
Compress better, Compute faster!
February 12, 2025 at 10:43 AM
🗣️ C-Blosc2 2.16.0 is out. We have added new features, like:
* _fseeki64/_ftelli64/_stat64 on Windows for large file support.
* 12-byte unshuffle for avx2 and sse2.
* Better description of the Blosc2 format as a whole.
Compress better, Compute faster!
* _fseeki64/_ftelli64/_stat64 on Windows for large file support.
* 12-byte unshuffle for avx2 and sse2.
* Better description of the Blosc2 format as a whole.
Compress better, Compute faster!
Reposted
It has been a blast to collaborate with the LEAPS-INNOV WP7 in such a nice project!
@Blosc2 makes compression even better for tomography in synchrotron facilities in Europe by allowing up to 2x better compression ratio, helping already good codecs to shine even more, without almost no loose in perceived quality.
Read our paper on how we achieved this:
blosc.org/docs/LEAPS-I...
Read our paper on how we achieved this:
blosc.org/docs/LEAPS-I...
December 26, 2024 at 1:39 PM
It has been a blast to collaborate with the LEAPS-INNOV WP7 in such a nice project!
Reposted
Using Intel's MKL has never been so easy...
Did you know that:
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
December 19, 2024 at 5:34 PM
Using Intel's MKL has never been so easy...
Reposted
This is a great milestone for the Blosc project. Thanks to all the contributors and donors that have made this release possible!
📢 The Blosc Development Team is proud to announce the release of Python-Blosc2 3.0.0 final! 🎉 🎉
See an introduction to the shiny new compute engine at: www.blosc.org/python-blosc...
Looking forward to what you can build with Python-Blosc2 3.0!
** Compress Better, Compute Bigger! **
See an introduction to the shiny new compute engine at: www.blosc.org/python-blosc...
Looking forward to what you can build with Python-Blosc2 3.0!
** Compress Better, Compute Bigger! **
December 13, 2024 at 12:48 PM
This is a great milestone for the Blosc project. Thanks to all the contributors and donors that have made this release possible!
Reposted
Blosc2 3.0 final is approaching. Yay!
📢 We are adding the latest bolts and nuts to the Blosc2 library before release 3.0.0.
In our last release candidate, we fixed a couple of issues that showed up in our recent tutorial at the PyData Global 2024.
github.com/Blosc/python...
We are curious on what you are going to build with it! 😀
In our last release candidate, we fixed a couple of issues that showed up in our recent tutorial at the PyData Global 2024.
github.com/Blosc/python...
We are curious on what you are going to build with it! 😀
December 11, 2024 at 1:29 PM
Blosc2 3.0 final is approaching. Yay!