Stitched together some Neovim autocmds with Niri window commands so that the app window is bound to the special "app" buffer position and size. One step closer to NeovimOS.

Also did a 3 card one - different tags all get IDs which makes me think of doing some sort of weird physical variable assignment thing.

More experiments with Apriltags:
a color-picker where
x=red
y=green
rotation=blue

freeform physical slider feels interesting

Book-to-soundtrack experiment - a projector setup where I send the book image off to an LLM for recommendations and then play with Spotify.

Meant to be kind of like putting on a record but for objects. (I clipped out the loading times.)

I got a mirror to experiment with the projector

Trying out april tags. Thinking about how it could complement hand tracking and vision models.

This is using github.com/arenaxr/apri... and I know what april tags are because of folk.computer.

Two-hand gets a bit more interesting

Getting a feel for projector and hand-tracking possibilities by experimenting with a color picker. I can use pointer finger without pinch if I give it a path where it doesn't have to go through other things - kind of like a maze.

Trying out hand-tracking triggered buttons and some simple LLM calls. There are definite limits imposed by hand-tracking and projector display - but they're kind of interesting ones.

With colors - this wasn't working well at first but I realized it was because the shift in light was throwing the webcam's auto-exposure. Turning on the overhead light fixed it.

Table buttons for the projector - hand-tracking and triggering on overlap seems generally promising.

Quick shelf tryout. Maybe should be -> group select into shelves and then books on there own can optionally be sorted into nearest embedded shelf.

Dilemma is probably I'm recreating limitations of physical objects - why only one shelf per book?