13 votes

How I feel about LLM (AI) writing

I love writing, it's one of the most human things about humanity. It's communication, art and sharing all at once. It's been fundamental to culture and progress for 1000's of years.

LLMs are, in a way, really good at writing. They have the larger part of human creative output distilled into their weights. So it was inevitable that more and more people would start publishing articles and blog posts written (all or in part) by AI agents.

I don't like it but I accept it, there really isn't anything I can do about it. What I was hoping, though, is that high signal to noise ratio places on the internet (Tildes among them) would reject it and we could go on consuming 100% organic prose, at least for a while.

And for while that's exactly what happened. In techy places like Hacker News, AI posts were quickly flagged and downvoted into oblivion. At Tildes they mostly didn't show up at all, or if they did I missed them.

That seems to be ending though. Now I see agent written pieces on the front page of HN with 100's of comments. There's always a highly upvoted comment pointing out that the piece is slop, but you have to scroll to find it.

The reason I use HN as an example is that it's full of people with extensive experience using AI agents who are in a position to tell if something is slop. And it looks like the larger part of readers (or at least commenters) can't tell the difference anymore. If that's true at HN, it's going to be true everywhere.

It is getting harder to tell when something is slop, people are post editing, handwriting intros and getting better at prompting to remove obvious LLM tells. But if you have any practical experience with these tools, it's still pretty easy to tell. Somewhere during post training certain patterns end up getting heavily favored. Interestingly, many of them happen across all of the frontier models. Em-dashes are the most famous but there are so many more. Most are rhetorical tricks or formatting patterns rather than punctuation.

Reading LLM prose, many of the tropes don't stand out at first, instead they land as strong writing. But after you see them repeat enough times they start to become obvious. Even putting the tropes aside, the hallmark of a lot of LLM writing is that it's more rhetoric than substance. Low signal, lots of noise.

I don't have a solution, it's starting to look like many (maybe most) people aren't going to be able to tell when they're consuming something that required minimal thought by the "author" who prompted the AI. Which is sad because, up until now, we could assume that, when we read something, someone cared enough to put time and mental bandwidth into creating it. That's become increasingly less true.

I suppose this post is me feeling wistful for the internet we used to have, written exclusively by humans. I continue to hope that people will reject slop at places like Tildes, but in order for them to do that they have to be able to identify it. Maybe people will get better at that, there is definitely a point where you've consumed enough slop that you can smell it from a mile away. But of course the slop is going to keep getting harder to detect.

I don't want to go as far as to say that slop will take over the internet, I think (hope) that people will keep wanting to read organic, human, writing. And that as a result we'll come up with strategies and solutions to support that.

It's a weird time. Right now every LLM blog post and article that goes viral is signalling to the prompter, and anyone watching who can tell what's happening, that there is demand for slop. And of course with demand comes profit. I think we're at the beginning of a steep curve.

4 comments

  1. xk3
    Link
    I think it's more that HN commenters either just read the title and not the article, or that they don't care anymore and are more interested in discussing the prompted topic. It's true that human...

    can't tell the difference anymore

    I think it's more that HN commenters either just read the title and not the article, or that they don't care anymore and are more interested in discussing the prompted topic.

    It's true that human writing feels more authentic and I often prefer handmade items to mass-produced plastic garbage. I empathize and also yearn for simpler times when spam was simple Markov chains. But eventually the complaining about slop becomes its own noise.

    On reddit you just have bots posting slop and bots complaining about slop. The dead internet theory has fully arrived at its terminus.

    7 votes
  2. [2]
    DynamoSunshirt
    Link
    I wish I had something more optimistic to add, other than... same. I used to love the internet because I loved the open exchange of ideas that transcended space and language and border. Text used...

    I wish I had something more optimistic to add, other than... same. I used to love the internet because I loved the open exchange of ideas that transcended space and language and border. Text used to be a decent barrier; I gravitated towards text-heavy communities like Tildes (and, once upon a time, HN, and parts of Reddit, and even certain Facebook communities back in the day). Everything has become infested with low-quality jokes, memes, and outright spam, leaving me my last bastions of sanity, like Tildes. HN has had problems for a long time, but the bot presence has become utterly unbearable lately.

    These grassroots communities are dying, replaced with utterly soulless astroturfing.

    I fear we've somehow implemented Dead Internet Theory. In a way it'll be nice to touch grass and use the internet less. But I'll miss the friends, the sense of community, the learning, and most of all the reminder of just how big and varied the world can be. It was amazing to wander onto the internet and find other nerds like yourself, whatever niche you care about most. But I guess most people are fine replacing that with homogeneous undifferentiated slop. It makes me very sad. I wonder where (if?) the next generation finds a way to create those niche communities, because it's clear that those nerd spaces are anathema to the capitalist urges of our techno overlords.

    It would be nice to see more third places show up in meatspace, but that's also being ruined by our oligarchs. So I really don't know what to hope for. Maybe a nice solar flare that could knock out 99% of modern computers and leave people OK? Aliens?

    6 votes
    1. R3qn65
      Link Parent
      I don't really disagree with anything you wrote, but as a small note of hope, I don't think that most people are fine or even indifferent. It's more that it doesn't take much effort to prompt and...

      But I guess most people are fine replacing that with homogeneous undifferentiated slop.

      I don't really disagree with anything you wrote, but as a small note of hope, I don't think that most people are fine or even indifferent. It's more that it doesn't take much effort to prompt and post AI slop, so the people doing that can easily overwhelm any forum's immune system. Though... Yeah, people don't actually read past the headline. That's not new with AI, but it's definitely worse now.

  3. nic
    Link
    Intuitively, we associate long and elegant writing with deep thought. People are constantly being led astray but this intuition. Sadly, many people barely read beyond the headline.

    Intuitively, we associate long and elegant writing with deep thought.

    People are constantly being led astray but this intuition.

    Sadly, many people barely read beyond the headline.

    1 vote