Following the release of DeepMind's TIPS model, I added support for text embeddings in Equimo. Just a few lines of code to embed text and images in the same space, enabling easy vision-language workflows in Jax.

Learn more at: github.com/clementpoire...
TIPS paper: arxiv.org/abs/2410.16512

SigLIP 2 has been recently released, so I just added support for it in my Jax model library, Equimo! Feel free to try it :)

github.com/clementpoire...

I just signed the exit of my own startup.
It's time to have some fun intermediate projects before the next big thing.

Let's take inspirations outside deep learning to come back stronger.

It ain't much, but it's honest work. I am open sourcing some model I am playing with.

Equimo is a JAX/Equinox library implementing modern vision architectures (2023-24). Features FasterViT, MLLA, VSSD, and more state-space/transformer models. Pure JAX implementation with modular design.

#MLSky