Learn how compression boosts array performance & enables cloud computing without downloads. ☁️
Watch here: 👇 www.youtube.com/watch?v=tUvS...
#Python #HPC #DataScience #BigData
Learn how compression boosts array performance & enables cloud computing without downloads. ☁️
Watch here: 👇 www.youtube.com/watch?v=tUvS...
#Python #HPC #DataScience #BigData
Create interactive plots in your mobile browser. No laptop needed!
Launch our demo, create graphs with Matplotlib/Plotly, customize, and render instantly. Register to save & share your work. 📈🎉
Try it: cat2.cloud/demo/static/...
✅ Streamlined computation for LazyUDFs
✅ Upload LazyUDFs for server-side execution in Caterva2
And as another consequence, Numba can now be integrated into your Blosc2 LazyUDF workflow very easily!
Find some surprising answers 👉 www.blosc.org/posts/roofli...
During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶
Enjoy!
#Blosc2 #HPC #NumPy #Numexpr
Find some surprising answers 👉 www.blosc.org/posts/roofli...
During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶
Enjoy!
#Blosc2 #HPC #NumPy #Numexpr
Parlarem de Cat2Cloud ☁️ : ironarray.io/cat2cloud
Com que és Black Friday, tenim un regalet preparat per als asistents! 🎁
Us esperem!
Parlarem de Cat2Cloud ☁️ : ironarray.io/cat2cloud
Com que és Black Friday, tenim un regalet preparat per als asistents! 🎁
Us esperem!
See how to move ➡️ , copy ©️ and perform other file management operations easily from the prompt box!
Stop downloading, start doing! 🔨
Don't miss out! Use the coupon code BLACKFRIDAY to get a generous 50% OFF your first order on Cat2Cloud. 💰
This offer is valid until Cyber Monday (Dec 1st), so don't delay! ⏳
Get it today! 👉 ironarray.io/pricing
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. ✨
Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/
#HDF5 #CloudComputing
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. ✨
Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/
#HDF5 #CloudComputing
Dinosaurs lived on the other side the Galaxy.
Dinosaurs lived on the other side the Galaxy.
Interact with your vasts remote datasets right in your phone!
cat2.cloud/demo/roots/@...
#Cat2Cloud #Blosc2 #BigData
Interact with your vasts remote datasets right in your phone!
cat2.cloud/demo/roots/@...
#Cat2Cloud #Blosc2 #BigData
With Cat2Cloud released this week we continue our 💊ironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!
Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, markdown to PDFs 📄 !
With Cat2Cloud released this week we continue our 💊ironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!
Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, markdown to PDFs 📄 !
Cat2Cloud's most exciting feature: 𝗿𝗲𝗺𝗼𝘁𝗲 𝗷𝘂𝗽𝘆𝘁𝗲𝗿 𝗻𝗼𝘁𝗲𝗯𝗼𝗼𝗸𝘀!
☁️ cloud-based computation
☁️ cloud-hosted data
☁️ cloud-hosted jupyter notebooks!
⚡No environment headaches, no waiting for computations - all in a seamless interface from the browser!
Bring computation directly to your data. Host, run, and share workflows with incredible speed. ⚡
Read the announcement: ironarray.io/blog/cat2clo...
#Cat2Cloud #BigData #DataScience #Python #HPC
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Blosc2 is part of the NumPy array library ecosystem: numpy.org
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:
𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱)
for 𝙰, 𝙱 PyTorch, Jax, Tensorflow, Zarr... arrays!
#Compute
#Tensor
#PyTorch
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
See how Blosc2 powers heavy-duty linear algebra (100GB!) workflows
⚡1.5-2x faster than PyTorch + h5py!
🧱 optimised chunking for your cache hierarchy
🐍 one line syntax 𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱, 𝚞𝚛𝚕𝚙𝚊𝚝𝚑='𝚘𝚞𝚝.𝚋𝟸𝚗𝚍')
See blog here: ironarray.io/blog/la-blosc
#Blosc2
#Data
#LinearAlgebra
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
Blosc2 as a mature computation engine >>>
• Array API standard compliance - 70 new functions
• Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
• Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
For ultimate speed, native Blosc2 containers are still king. 🏎️
Code: gist.github.com/FrancescAlte...
#Python #DataScience #NumPy #Performance #Blosc