The purpose of a document is to help an LLM answer questions about said document.

Claude is something special.

Very cool work from Meta AI: Large Concept Models. Idea: autoregress in the space of sentence level representations.

I think an interesting next step would be to layer this on conventional LLMs / token prediction models.

Here’s how that could work: ⤵️

Results? Good stuff.

🧵⤵️

The idea is to model two things:
(a) if concepts fit together to make good art, and
(b) if people have already thought about that combination of concepts (“cognitive availability”).

Seek out the combos for which (a) is true but (b) isn’t, and ask a text-to-image model to render that.

🧵⤵️

My MSc advisee (& gang) cooked.

tl:dr — a cute technique to get machines to be more creative.

🧵⤵️

If you aren’t already doing this: share that pdf with Claude.