Ritchie Vink
ritchie46.bsky.social
Ritchie Vink
@ritchie46.bsky.social
Author and Founder of Polars
Struct:

Think of a tuple with named fields. Or multiple columns in a single column.
September 16, 2025 at 5:49 PM
4/4
Many new expressions are lowered to the streaming engine. This means you can run more queries faster!

See the full changelog here:

github.com/pola-rs/pola...
Release Python Polars 1.32.0 · pola-rs/polars
🏆 Highlights Make Selector a concrete part of the DSL (#23351) Rework Categorical/Enum to use (Frozen)Categories (#23016) 🚀 Performance improvements Lower Expr.slice to streaming engine (#23683)...
github.com
August 11, 2025 at 3:03 PM
3/4
More joins will be lowered to more strict variants based on predicates. This can save a lot of intermediate rows!
August 11, 2025 at 3:03 PM
2/4
The Categorical type is now streaming! No `StringCache` anymore and working Categoricals in distributed Polars.

github.com/pola-rs/pola...
refactor: Rework Categorical/Enum to use (Frozen)Categories by orlp · Pull Request #23016 · pola-rs/polars
NoteTLDR Categoricals are completely reimplemented to be streaming compatible and fit better into the Polars Data model. They should generally be faster, more stable and more reliable. Physical ord...
github.com
August 11, 2025 at 3:03 PM
Yeah, or even for single machine remotely. E.g. let's say you run a very small node as airflow orchestrator, but need a big VM for the ETL job. That orchestrator can initiate the remote query and doesn't have to worry about hardware setup/teardown.
February 17, 2025 at 1:44 PM
He is a notorious Polars hater and has tweeted he wants the project to fail.

He fears the fact that Polars deviation from the pandas API will splinter the landscape and doesn't appreciate new API development. I haven't read a technical reason from his side.
February 3, 2025 at 11:48 AM
That was all pre 1.0.

We've released 1.0 in july last year. The API is stable now.
January 28, 2025 at 7:36 PM
I would call that a weakness of the AI. 😅
January 28, 2025 at 5:09 PM
Interesting. is it an authentication error with Azure Storage?
December 8, 2024 at 6:11 AM