20 votes

OpenAI considers allowing users to create AI-generated pornography

11 comments

  1. [3]
    Acorn_CK
    Link
    How could they not consider it? Think about how good Sora is right now, and that it'll only get better. Custom pornography, exactly what the person desires - can you imagine the amount of...

    How could they not consider it? Think about how good Sora is right now, and that it'll only get better. Custom pornography, exactly what the person desires - can you imagine the amount of potential money? Absolutely insane. Celebrities and hot people could even license their likeness to the company and split the profits. A porn star of the future might only need to do a few scenes, and then AI can take over from there.

    Frankly, I'm not opposed whatsoever. I would hazard a guess that it would even lower the amount of exploitative pornography being made IRL, as I gather that remains a prevalent problem in the industry today. Hell, it might even prevent a few instances of sexual violence here and there - maybe some would have less need to act on the impulse if you can just pay for a great video of the harmful urge.

    I will openly admit this is just me speculating, who knows, it could also make things worse. But the thing is - that genie is out of the bottle already. Deepnude can be run on a home computer with very little effort already. The video generation will follow. They're just trying to stay ahead of the curve, and cash in as much as possible on their position in the AI market.

    25 votes
    1. [2]
      lou
      Link Parent
      https://www.psychologytoday.com/intl/blog/all-about-sex/201601/evidence-mounts-more-porn-less-sexual-assault
      6 votes
      1. Acorn_CK
        Link Parent
        Thanks! Yeah, that is something I thought I recalled seeing at some point, but I didn't feel like vetting a proper source. Makes a lot of sense to me.

        Thanks! Yeah, that is something I thought I recalled seeing at some point, but I didn't feel like vetting a proper source. Makes a lot of sense to me.

        4 votes
  2. [3]
    Wes
    (edited )
    Link
    Title: "OpenAI considers allowing users to create AI-generated pornography" Article: "An OpenAI spokesperson said in a statement on Thursday that the company had no intention to create...

    Title: "OpenAI considers allowing users to create AI-generated pornography"

    Article: "An OpenAI spokesperson said in a statement on Thursday that the company had no intention to create AI-generated pornography."

    Pretty darn misleading. They seem to be talking about allowing some NSFW writing, only when the user specifically asks for it. Yes the word "pornography" might refer to writings if you squint hard enough, but the article also mentions DALL-E right before describing the new proposal. I don't see any indication that this relates to their image generator at all.

    18 votes
    1. [2]
      PelagiusSeptim
      Link Parent
      "Joanne Jang, an employee at the San Francisco-based company who worked on the document, told the US news organisation NPR that OpenAI wanted to start a discussion about whether the generation of...

      "Joanne Jang, an employee at the San Francisco-based company who worked on the document, told the US news organisation NPR that OpenAI wanted to start a discussion about whether the generation of erotic text and nude images should always be banned from its products."

      Seems the image generator is very much part of this discussion.

      14 votes
      1. Wes
        Link Parent
        Thanks for pointing that out. I clicked through to the spec proposal and all of the examples were for text, but it seems like maybe they're considering artistic nudity as well (so separating...

        Thanks for pointing that out. I clicked through to the spec proposal and all of the examples were for text, but it seems like maybe they're considering artistic nudity as well (so separating nudity and sexuality) then?

        I think the headline is still misleading in this case, but that is still an interesting proposal.

        4 votes
  3. [2]
    tanglisha
    Link
    The porn industry has always been at the forefront of the Internet, there's no reason that will change now. If OpenAI doesn't do it someone else will, then they'll get the profits. Ownership and...

    The porn industry has always been at the forefront of the Internet, there's no reason that will change now. If OpenAI doesn't do it someone else will, then they'll get the profits.

    Ownership and responsibility still seem to be a bit hazy, though. What happens when a teenager uses it to generate porn with kids their own age? Even if it's not allowed, someone clever will figure out how to get around the rules and share that with the world.

    12 votes
    1. CptBluebear
      Link Parent
      That's already possible if you self host an instance of something like stable diffusion and train it on the bad stuff.

      That's already possible if you self host an instance of something like stable diffusion and train it on the bad stuff.

      1 vote
  4. Macil
    (edited )
    Link
    Regardless of whether you specifically want to do NSFW things with AI tools, this kind of policy change would also help prevent people from being incorrectly blocked from working on SFW things. I...

    Regardless of whether you specifically want to do NSFW things with AI tools, this kind of policy change would also help prevent people from being incorrectly blocked from working on SFW things. I think a lot of users of commercial AI tools (image or text generation) that aren't trying to make NSFW content have experienced the system overzealously blocking a request that it mistakenly identified as inappropriate. I've run into it and it's a common complaint I've seen in discussions.

    Imagine if Photoshop fully stopped working on a photo because it thought it was NSFW because it thought it showed too much skin. Tools shouldn't impose themselves on users like that, especially not for such prudish reasons by tools with fallible judgment that offer no override.

    5 votes
  5. [2]
    teaearlgraycold
    Link
    For the people working on this I have to wonder what that’s like - relating to corporate culture. I assume that any budding projects in this area are one or two person operations. But if you’re a...

    For the people working on this I have to wonder what that’s like - relating to corporate culture. I assume that any budding projects in this area are one or two person operations. But if you’re a large corporation funded by Microsoft how do you just start having teams of people look at porn all day long at the office? I’m not trying to be a moral crusader here. But presumably the standard rules around porn would still apply to everyone else. I know someone who got fired for that in the past (he may have been a repeat offender for all I know).

    2 votes
    1. stu2b50
      Link Parent
      I mean, for context, the article is about easing the filters and restrictions they have on chatgpt w.r.g to erotica. I don't think you need to stare at porn all day to do that.

      I mean, for context, the article is about easing the filters and restrictions they have on chatgpt w.r.g to erotica. I don't think you need to stare at porn all day to do that.

      3 votes