13 votes

The "AI girlfriend" website Muah.AI suffered a data breach

10 comments

  1. drannex
    Link
    Not directly directly related but, this is kind of comical when you realize and the first I had heard about them when they've only just started driving around a Cybertruck with their (rather...

    Not directly directly related but, this is kind of comical when you realize and the first I had heard about them when they've only just started driving around a Cybertruck with their (rather horrendous) logo emblazoned on all sides around LA. I can't find the one that I saw, but here's a xitter post.

    9 votes
  2. [8]
    ackables
    (edited )
    Link
    As a summary for people who didn’t click the link, there are apparently many users using the AI to create CSAM role play scenarios. I have not read any research on this, but does using AI to...

    As a summary for people who didn’t click the link, there are apparently many users using the AI to create CSAM role play scenarios.

    I have not read any research on this, but does using AI to create CSAM reduce the market for real CSAM? Does AI CSAM actually protect children by reducing the demand for real CSAM?

    Ideally, there would be no CSAM, but even with cultural taboos and many laws against it, people still make it. Is this an effective form of harm reduction?

    9 votes
    1. [3]
      lou
      (edited )
      Link Parent
      I would say that most people consider immoral sex so egregious that even its simulation is viewed as immoral and unacceptable to a degree that is comparable to real sex acts. From a philosophycal...

      I would say that most people consider immoral sex so egregious that even its simulation is viewed as immoral and unacceptable to a degree that is comparable to real sex acts. From a philosophycal standpoint, I don't quite agree. But that seems to be the hegemonic view.

      That is easy to perceive just by imagining two completely asexual men that are equal in every way with the exception that one of them used an AI to role-play CSAM. I'm sure even you find the one who did not use the AI more moral than the other.

      EDIT

      Those are axiomatic sentiments which require no consequence.

      Another well known example is incest, which most people will view as immoral even in hypothetical scenarios in which all harmful consequences are removed.

      10 votes
      1. [2]
        ackables
        Link Parent
        Oh yeah I think all kinds of CSAM is immoral even if it’s a drawing or AI generated. I’m not trying to say that there’s some scenario where CSAM is acceptable. I also don’t even know if AI CSAM...

        Oh yeah I think all kinds of CSAM is immoral even if it’s a drawing or AI generated. I’m not trying to say that there’s some scenario where CSAM is acceptable.

        I also don’t even know if AI CSAM decreases the demand for real CSAM, so my theory may be completely wrong. I am just wondering if AI CSAM can lead to less bad outcomes for real children.

        4 votes
        1. lou
          (edited )
          Link Parent
          To be fair, I do not necessarily agree that simulation of immoral sex acts is inherently immoral. That is a complex issue about which I do not have fixed beliefs. So I was definitely not making a...

          To be fair, I do not necessarily agree that simulation of immoral sex acts is inherently immoral. That is a complex issue about which I do not have fixed beliefs. So I was definitely not making a judgment on your or anyone else's morality, but rather clarifying how I think most people seem to think about those issues. I wanted to highlight that this is often more about virtue than consequence. Even when people think they're only concerned with consequence. By that I mean that people clearly consider some acts immoral due to their inherent nature rather than their effects.

          8 votes
    2. Ullallulloo
      Link Parent
      In my experience, there's quite a disagreement on that. The traditional view is that using any form of CSAM feeds and normalizes those desires and makes escalating things more likely. The more...

      In my experience, there's quite a disagreement on that. The traditional view is that using any form of CSAM feeds and normalizes those desires and makes escalating things more likely. The more modern view is that sexuality is very rigid and they're going to have the same orientation and desires either way, so having a virtual outlet will reduce the chance of real harm.

      Personally, I agree with the former, but I think it's fair to say that no good study can really be done on it to know for sure.

      9 votes
    3. [2]
      Lobachevsky
      Link Parent
      Wasn't the CSAM label specifically differentiated from CP so that it describes actual abuse materials? Sounds like you're just using the term to refer to CP here. I can't really wrap my head...

      Wasn't the CSAM label specifically differentiated from CP so that it describes actual abuse materials? Sounds like you're just using the term to refer to CP here. I can't really wrap my head around AI generated stuff being abuse materials I guess.

      2 votes
      1. ackables
        Link Parent
        I thought they changed the term to CSAM because even if it’s a drawing or AI generated, it still depicts abuse. If you call it CP, it sounds more like a fetish or category on a porn website...

        I thought they changed the term to CSAM because even if it’s a drawing or AI generated, it still depicts abuse. If you call it CP, it sounds more like a fetish or category on a porn website instead of a crime.

        5 votes
    4. MimicSquid
      Link Parent
      Depending on the jurisdiction, even that AI roleplay is illegal because of what it portrays. A matter of definitions: AI doesn't reduce the demand for the things it generates. It wildly increases...

      Depending on the jurisdiction, even that AI roleplay is illegal because of what it portrays.

      A matter of definitions: AI doesn't reduce the demand for the things it generates. It wildly increases supply, thus depressing the economic value of competing products. To the degree that CSAM involving actual people is being generated for economic gain, I imagine it will decrease the rate of production. I have no data on the motivations behind the creation of such material, so can't say the magnitude of the actual effect.

      To the degree that use of AI generated material replaces material that was created through harm to actual individuals, it seems like it is reducing the harm inflicted? That feels tenuous, though.

      2 votes
  3. datavoid
    Link
    I need to get into using weird text formatting

    I need to get into using weird text formatting