Sotos Tsaftaris
stsaftaris.bsky.social
Sotos Tsaftaris
@stsaftaris.bsky.social
Professor in ML & CV at University of Edinburgh, https://vios.science
Director of CHAI https://chai.ac.uk
Canon Medical/RAEng Chair in Healthcare AI. Fellow ELLIS
(Views my own)
🧵7/7 Image Credits: Curiosamente alucinante
February 6, 2025 at 2:16 PM
🧵 6/7
What other analogies can you draw between the book and LLMs? Think about learned embeddings, attention mechanisms, etc. Let's discuss! 👇 #Analogy #TechTalk
February 6, 2025 at 2:16 PM
🧵 5/7
Now for the techy bit: The core principle at play is compositionality. The book combines lines to create poems, LLMs combine words, sub-word units, and learned representations to generate text. This combined with massive datasets and complex architectures, enables diverse and novel outputs.
February 6, 2025 at 2:16 PM
🧵4/7
So next time you're amazed by an LLM's writing skills, remember Cent mille milliards de poèmes. It's a beautiful illustration of how a little creativity and a LOT of combinations can go a LONG way. 📚➡️💻 #RaymondQueneau #CentMilleMilliardsDePoemes
February 6, 2025 at 2:16 PM
🧵3/7
Just like the book can create an almost infinite number of poems, LLMs can generate a mind-boggling variety of text. 🤯 From poems to code, emails to essays, it's all about combining the building blocks in new and creative ways. ✨ #ChatGPT #deepseek #gemini #claude
February 6, 2025 at 2:16 PM
🧵 2/7
Think of it like this: each line in the book is like a word in an LLM's vocabulary. 🔤 The book's structure? That's like the LLM's grammar rules. ⚙️ And every new poem you create? That's like the LLM generating a unique sentence or story! ✍️ #Creativity #Innovation
February 6, 2025 at 2:16 PM