LLM failures to reason, as documented in Apple’s Illusion of Thinking paper, are really only part of a much deeper problem

Arm yourself with knowledge

YouTube video by Pavel Jirásek

Scientists from the University of Sheffield will warn policymakers that the shrinking glaciers of the Andes threaten the water supply of 90 million people on the South American continent at the first-...

Today's links Why I don't like AI art: I think I've figured it out. Hey look at this: Delights to delectate. Object permanence: 2010, 2015, 2020, 2024 Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Why I don't like AI art (permalink) A law professor friend tells me that LLMs have completely transformed the way she relates to grad students and post-docs – for the worse. And no, it's not that they're cheating on their homework or using LLMs to write briefs full of hallucinated cases. The thing that LLMs have changed in my friend's law school is letters of reference. Historically, students would only ask a prof for a letter of reference if they knew the prof really rated them. Writing a good reference is a ton of work, and that's rather the point: the mere fact that a law prof was willing to write one for you represents a signal about how highly they value you. It's a form of proof of work. But then came the chatbots and with them, the knowledge that a reference letter could be generated by feeding three bullet points to a chatbot and having it generate five paragraphs of florid nonsense based on those three short sentences. Suddenly, profs were expected to write letters for many, many students – not just the top performers. Of course, this was also happening at other universities, meaning that when my friend's school opened up for postdocs, they were inundated with letters of reference from profs elsewhere. Naturally, they handled this flood by feeding each letter back into an LLM and asking it to boil it down to three bullet points. No one thinks that these are identical to the three bullet points that were used to generate the letters, but it's close enough, right? Obviously, this is terrible. At this point, letters of reference might as well consist solely of three bullet-points on letterhead. After all, the entire communicative intent in a chatbot-generated letter is just those three bullets. Everything else is padding, and all it does is dilute the communicative intent of the work. No matter how grammatically correct or even stylistically interesting the AI generated sentences are, they have less communicative freight than the three original bullet points. After all, the AI doesn't know anything about the grad student, so anything it adds to those three bullet points are, by definition, irrelevant to the question of whether they're well suited for a postdoc. Which brings me to art. As a working artist in his third decade of professional life, I've concluded that the point of art is to take a big, numinous, irreducible feeling that fills the artist's mind, and attempt to infuse that feeling into some artistic vessel – a book, a painting, a song, a dance, a sculpture, etc – in the hopes that this work will cause a loose facsimile of that numinous, irreducible feeling to manifest in someone else's mind. Art, in other words, is an act of communication – and there you have the problem with AI art. As a writer, when I write a novel, I make tens – if not hundreds – of thousands of tiny decisions that are in service to this business of causing my big, irreducible, numinous feeling to materialize in your mind. Most of those decisions aren't even conscious, but they are definitely decisions, and I don't make them solely on the basis of probabilistic autocomplete. One of my novels may be good and it may be bad, but one thing is definitely is is rich in communicative intent. Every one of those microdecisions is an expression of artistic intent. Now, I'm not much of a visual artist. I can't draw, though I really enjoy creating collages, which you can see here: https://www.flickr.com/photos/doctorow/albums/72177720316719208 I can tell you that every time I move a layer, change the color balance, or use the lasso tool to nip a few pixels out of a 19th century editorial cartoon that I'm matting into a modern backdrop, I'm making a communicative decision. The goal isn't "perfection" or "photorealism." I'm not trying to spin around really quick in order to get a look at the stuff behind me in Plato's cave. I am making communicative choices. What's more: working with that lasso tool on a 10,000 pixel-wide Library of Congress scan of a painting from the cover of Puck magazine or a 15,000 pixel wide scan of Hieronymus Bosch's Garden of Earthly Delights means that I'm touching the smallest individual contours of each brushstroke. This is quite a meditative experience – but it's also quite a communicative one. Tracing the smallest irregularities in a brushstroke definitely materializes a theory of mind for me, in which I can feel the artist reaching out across time to convey something to me via the tiny microdecisions I'm going over with my cursor. Herein lies the problem with AI art. Just like with a law school letter of reference generated from three bullet points, the prompt given to an AI to produce creative writing or an image is the sum total of the communicative intent infused into the work. The prompter has a big, numinous, irreducible feeling and they want to infuse it into a work in order to materialize versions of that feeling in your mind and mine. When they deliver a single line's worth of description into the prompt box, then – by definition – that's the only part that carries any communicative freight. The AI has taken one sentence's worth of actual communication intended to convey the big, numinous, irreducible feeling and diluted it amongst a thousand brushtrokes or 10,000 words. I think this is what we mean when we say AI art is soul-less and sterile. Like the five paragraphs of nonsense generated from three bullet points from a law prof, the AI is padding out the part that makes this art – the microdecisions intended to convey the big, numinous, irreducible feeling – with a bunch of stuff that has no communicative intent and therefore can't be art. If my thesis is right, then the more you work with the AI, the more art-like its output becomes. If the AI generates 50 variations from your prompt and you choose one, that's one more microdecision infused into the work. If you re-prompt and re-re-prompt the AI to generate refinements, then each of those prompts is a new payload of microdecisions that the AI can spread out across all the words of pixels, increasing the amount of communicative intent in each one. Finally: not all art is verbose. Marcel Duchamp's "Fountain" – a urinal signed "R. Mutt" – has very few communicative choices. Duchamp chose the urinal, chose the paint, painted the signature, came up with a title (probably some other choices went into it, too). It's a significant work of art. I know because when I look at it I feel a big, numinous irreducible feeling that Duchamp infused in the work so that I could experience a facsimile of Duchamp's artistic impulse. There are individual sentences, brushstrokes, single dance-steps that initiate the upload of the creator's numinous, irreducible feeling directly into my brain. It's possible that a single very good prompt could produce text or an image that had artistic meaning. But it's not likely, in just the same way that scribbling three words on a sheet of paper or painting a single brushstroke will produce a meaningful work of art. Most art is somewhat verbose (but not all of it). So there you have it: the reason I don't like AI art. It's not that AI artists lack for the big, numinous irreducible feelings. I firmly believe we all have those. The problem is that an AI prompt has very little communicative intent and nearly all (but not every) good piece of art has more communicative intent than fits into an AI prompt. (Image: Cryteria, CC BY 3.0, modified) Hey look at this (permalink) Spammers are more consistent at making SPF, DKIM, and DMARC correct than are legitimate senders https://toad.social/@grumpybozo/114213600922816869 The Turd Reich https://mcusercontent.com/bd36014b9888db9081d204e78/files/27983e2f-9aa0-bf57-321f-53c4dbdeb252/the_turd_reich_A0_.pdf (h/t Crystaltips) Merchant of Menace: Trump and the Jews https://prospect.org/politics/2025-03-25-merchant-of-menace-trump-and-the-jews/ Object permanence (permalink) #15yrsago Secret copyright treaty will sideline the UN and replace it with private club of rich countries https://www.michaelgeist.ca/2010/03/acta-superstructure/ #15yrsago Discarded photocopier hard drives stuffed full of corporate secrets https://web.archive.org/web/20100322192937/http://www.thestar.com/news/gta/article/781567–high-tech-copy-machines-a-gold-mine-for-data-thieves #10yrsago If Indiana legalizes homophobic discrimination, Gen Con’s leaving Indianapolis https://files.gencon.com/Gen_Con_Statement_Regarding_SB101.pdf #10yrsago Sandwars: the mafias whose illegal sand mines make whole islands vanish https://www.wired.com/2015/03/illegal-sand-mining/<?a> #10yrsago Woman medicated in a psychiatric ward until she said Obama didn’t follow her on Twitter https://www.independent.co.uk/news/world/americas/woman-held-in-psychiatric-ward-after-correctly-saying-obama-follows-her-on-twitter-10132662.html #10yrsago As crypto wars begin, FBI silently removes sensible advice to encrypt your devices https://www.techdirt.com/2015/03/26/fbi-quietly-removes-recommendation-to-encrypt-your-phone-as-fbi-director-warns-how-encryption-will-lead-to-tears/ #10yrsago Australia outlaws warrant canaries https://arstechnica.com/tech-policy/2015/03/australian-government-minister-dodge-new-data-retention-law-like-this/ #10yrsago TPP leak: states give companies the right to repeal nations’ laws https://www.eff.org/deeplinks/2015/02/its-time-act-now-congress-poised-introduce-bill-fast-track-tpp-next-week #5yrsago Social distancing and other diseases https://pluralistic.net/2020/03/26/badger-masks/#flu-too #5yrsago Record wind-power growth https://pluralistic.net/2020/03/26/badger-masks/#blows-blows #5yrsago Sanders on GOP stimulus cruelty https://pluralistic.net/2020/03/26/badger-masks/#unlimited-cruelty #5yrsago Canada nationalizes covid patents https://pluralistic.net/2020/03/26/badger-masks/#c13 #5yrsago LoC plugs Little Brother https://pluralistic.net/2020/03/26/badger-masks/#lb-loc #5yrsago The ideology of economics https://pluralistic.net/2020/03/26/badger-masks/#piketty #1yrago Meatspace twiddling https://pluralistic.net/2024/03/26/glitchbread/#electronic-shelf-tags Upcoming appearances (permalink) Chicago: Picks and Shovels with Peter Sagal, Apr 2 https://exileinbookville.com/events/44853 Chicago: ABA Techshow, Apr 3 https://www.techshow.com/ Bloomington: Picks and Shovels at Morgenstern, Apr 4 https://morgensternbooks.com/event/2025-04-04/author-event-cory-doctorow Pittsburgh: Picks and Shovels at White Whale Books, May 15 https://whitewhalebookstore.com/events/20250515 Pittsburgh: PyCon, May 16 https://us.pycon.org/2025/schedule/ PDX: Teardown 2025, Jun 20-22 https://www.crowdsupply.com/teardown/portland-2025 PDX: Picks and Shovels at Barnes and Noble, Jun 20 https://stores.barnesandnoble.com/event/9780062183697-0 New Orleans: DeepSouthCon63, Oct 10-12, 2025 http://www.contraflowscifi.org/ Recent appearances (permalink) Capitalists Hate Capitalism (MMT Podcast) https://pileusmmt.libsyn.com/195-capitalists-hate-capitalism-with-cory-doctorow How to Destroy Our Tech Overlords (Homeless Romantic) https://www.youtube.com/watch?v=epma2B0wjzU The internet that could have been was ruined by billionaires (Real News Network) https://therealnews.com/the-internet-that-could-have-been-was-ruined-by-billionaires Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). Signed, personalized copies at Dark Delicacies (https://www.darkdel.com/store/p3062/Available_Feb_20th%3A_The_Bezzle_HB.html#/). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). Signed, personalized copies at Dark Delicacies (https://www.darkdel.com/store/p3007/Pre-Order_Signed_Copies%3A_The_Lost_Cause_HB.html#/) "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. Signed copies at Dark Delicacies (US): and Forbidden Planet (UK): https://forbiddenplanet.com/385004-red-team-blues-signed-edition-hardcover/. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com "Attack Surface": The third Little Brother novel, a standalone technothriller for adults. The Washington Post called it "a political cyberthriller, vigorous, bold and savvy about the limits of revolution and resistance." Order signed, personalized copies from Dark Delicacies https://www.darkdel.com/store/p1840/Available_Now%3A_Attack_Surface.html "How to Destroy Surveillance Capitalism": an anti-monopoly pamphlet analyzing the true harms of surveillance capitalism and proposing a solution. https://onezero.medium.com/how-to-destroy-surveillance-capitalism-8135e6744d59?sk=f6cd10e54e20a07d4c6d0f3ac011af6b) (signed copies: https://www.darkdel.com/store/p2024/Available_Now%3A__How_to_Destroy_Surveillance_Capitalism.html) "Little Brother/Homeland": A reissue omnibus edition with a new introduction by Edward Snowden: https://us.macmillan.com/books/9781250774583; personalized/signed copies here: https://www.darkdel.com/store/p1750/July%3A__Little_Brother_%26_Homeland.html "Poesy the Monster Slayer" a picture book about monsters, bedtime, gender, and kicking ass. Order here: https://us.macmillan.com/books/9781626723627. Get a personalized, signed copy here: https://www.darkdel.com/store/p2682/Corey_Doctorow%3A_Poesy_the_Monster_Slayer_HB.html#/. Upcoming books (permalink) Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 Colophon (permalink) Today's top sources: Currently writing: Enshittification: a nonfiction book about platform decay for Farrar, Straus, Giroux. Status: second pass edit underway (readaloud) A Little Brother short story about DIY insulin PLANNING Picks and Shovels, a Martin Hench noir thriller about the heroic era of the PC. FORTHCOMING TOR BOOKS FEB 2025 Latest podcast: With Great Power Came No Responsibility: How Enshittification Conquered the 21st Century and How We Can Overthrow It https://craphound.com/news/2025/02/26/with-great-power-came-no-responsibility-how-enshittification-conquered-the-21st-century-and-how-we-can-overthrow-it/ This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla ISSN: 3066-764X

Decades of government kowtowing to Big Tech has thus far failed to produce a decisive victory

Reflections, learnings and take-aways from JRF's November 2024 workshop, aimed at mapping and assessing sources of AI countervailing power in the UK.