What I've learned last week building this multimodal search tool:
- @electronjs.org can embed a running python server (big up)
- Imagebind (by meta) works quite well for cross embeddings search
- Tensorflow is a pain in the ass to add next to a torch model
- @windsurfai.bsky.social is a killer app

Quick #chromeextension this week-end, using @lmstudio-ai.bsky.social locally, with llama-3.2-3b-instruct:2 model. The context is big enough to ingest most regular website. I assume such extension could be experimented further using vision models. Nice opensource alternative to regular APIs.

Detailed images:

Work by Nyria Graber, Jonathan Vögele, Steve Bouillant, Yann Müller, Andreas Abbaszadeh and Teo Grajqevci.

Detailed images

Work by Dalia Spichtig, Laurine Gigandet, Brikeld Hoxha, Herman Verhelst, Shana Meinecke, Daniel Rocha

Detailed images:
Installation view
#creativecoding #workshop #threejs #firebase. #interactive3d

Work by Dalia Spichtig, Laurine Gigandet, Brikeld Hoxha, Herman Verhelst, Shana Meinecke, Daniel Rocha, Nyria Graber, Jonathan Vögele, Steve Bouillant, Yann Müller, Andreas Abbaszadeh and Teo Grajqevci.

6x6, "Wonder chamber".
#creativecoding #workshop with @ecal_mid 2nd year students. #2024

Work by Dalia Spichtig, Laurine Gigandet, Brikeld Hoxha, Herman Verhelst, Shana Meinecke, Daniel Rocha, Nyria Graber, Jonathan Vögele, Steve Bouillant, Yann Müller, Andreas Abbaszadeh and Teo Grajqevci.

Custom Audio interface UI for my class about WebAudio API @ECAL.
At the begining, the idea was just to illustrate the concept of audio nodes. I've end up with: custom effects modules, dynamic coding visualizers and times sampler controllers.
I got lost.

#vanilla #javascript #interface #cursor