Check out our latest work "AI as Humanity's Salieri," featured in ✨News from Science ✨. Dive into how we quantify linguistic creativity and explore: Are LLMs 🤖 as creative as humans 👩🎓? Link: www.science.org/content/arti...
AI writing is improving, but it still can’t match human creativity
Computer program finds that ChatGPT and its ilk remix words well, yet their output remains derivative
science.org
Excited to talk about our latest work, "AI as Humanity's Salieri," at Fireside Chat today at 7 PM PST! 🔥 app.ploutos.dev/streams/inno...
See our latest work on (among other things) machine text detection through linguistic creativity measurement!
Ximing Lu@gximing.bsky.social · 2y agoAre LLMs 🤖 as creative as humans 👩🎓? Not quite! Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲
This corresponds to our observations (in a different setting) of vocabulary collapse when models trained on their own outputs (basically all of RLHF) bsky.app/profile/yoav... Did you look at pre-post-training models? (show some hyphen love ❤️)
Yoav Artzi@yoavartzi.com · 2y agoNew paper! Models that learn from feedback train on their own outputs, so you see performance 📈 but language diversity 📉. We show that if you couple comprehension and generation you learn faster 🏎️ AND get richer language! arxiv.org/abs/2408.15992 Demo and video ⬇ + in EMNLP!
Are LLMs 🤖 as creative as humans 👩🎓? Not quite! Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲