Unroll a video.

instructional video → step-by-step animated guide

Interpolate abstract concepts using analogies.

peaceful → dove
aggressive → falcon

Multimodal interpolation with text ↔ image ↔ audio.

Interpolate concepts in latent space

Transforming between modalities could be interesting.

text ↔ image ↔ video

text → image: image generation
image → video: video generation
video → image: highlight detection
image → text: image captioning

🤏 Semantic pinching

What if you can pinch your screen to transform an article 📝 into an emoji 💪 and reverse!

Here is a simple prototype that uses LLM + gestures to transform text between different levels of abstractions:
emoji ↔ word ↔ sentence ↔ paragraph ↔ article

🌐 semanticpinching.vercel.app