Pinned
Ximing Lu
@gximing.bsky.social
· Dec 23
AI writing is improving, but it still can’t match human creativity
Computer program finds that ChatGPT and its ilk remix words well, yet their output remains derivative
www.science.org
Check out our latest work "AI as Humanity's Salieri," featured in ✨News from Science ✨. Dive into how we quantify linguistic creativity and explore: Are LLMs 🤖 as creative as humans 👩🎓?
Link: www.science.org/content/arti...
Link: www.science.org/content/arti...
Check out our latest work "AI as Humanity's Salieri," featured in ✨News from Science ✨. Dive into how we quantify linguistic creativity and explore: Are LLMs 🤖 as creative as humans 👩🎓?
Link: www.science.org/content/arti...
Link: www.science.org/content/arti...
AI writing is improving, but it still can’t match human creativity
Computer program finds that ChatGPT and its ilk remix words well, yet their output remains derivative
www.science.org
December 23, 2024 at 6:44 PM
Check out our latest work "AI as Humanity's Salieri," featured in ✨News from Science ✨. Dive into how we quantify linguistic creativity and explore: Are LLMs 🤖 as creative as humans 👩🎓?
Link: www.science.org/content/arti...
Link: www.science.org/content/arti...
Excited to talk about our latest work, "AI as Humanity's Salieri," at Fireside Chat today at 7 PM PST! 🔥
app.ploutos.dev/streams/inno...
app.ploutos.dev/streams/inno...
December 22, 2024 at 11:33 PM
Excited to talk about our latest work, "AI as Humanity's Salieri," at Fireside Chat today at 7 PM PST! 🔥
app.ploutos.dev/streams/inno...
app.ploutos.dev/streams/inno...
Reposted by Ximing Lu
See our latest work on (among other things) machine text detection through linguistic creativity measurement!
Are LLMs 🤖 as creative as humans 👩🎓? Not quite!
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
November 22, 2024 at 7:07 PM
See our latest work on (among other things) machine text detection through linguistic creativity measurement!
Reposted by Ximing Lu
This corresponds to our observations (in a different setting) of vocabulary collapse when models trained on their own outputs (basically all of RLHF)
bsky.app/profile/yoav...
Did you look at pre-post-training models?
(show some hyphen love ❤️)
bsky.app/profile/yoav...
Did you look at pre-post-training models?
(show some hyphen love ❤️)
New paper!
Models that learn from feedback train on their own outputs, so you see performance 📈 but language diversity 📉. We show that if you couple comprehension and generation you learn faster 🏎️ AND get richer language!
arxiv.org/abs/2408.15992
Demo and video ⬇ + in EMNLP!
Models that learn from feedback train on their own outputs, so you see performance 📈 but language diversity 📉. We show that if you couple comprehension and generation you learn faster 🏎️ AND get richer language!
arxiv.org/abs/2408.15992
Demo and video ⬇ + in EMNLP!
November 22, 2024 at 3:32 PM
This corresponds to our observations (in a different setting) of vocabulary collapse when models trained on their own outputs (basically all of RLHF)
bsky.app/profile/yoav...
Did you look at pre-post-training models?
(show some hyphen love ❤️)
bsky.app/profile/yoav...
Did you look at pre-post-training models?
(show some hyphen love ❤️)
Are LLMs 🤖 as creative as humans 👩🎓? Not quite!
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
November 22, 2024 at 2:00 AM
Are LLMs 🤖 as creative as humans 👩🎓? Not quite!
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲