24
votes
Millions of people are using abusive AI ‘Nudify’ bots on Telegram
Link information
This data is scraped automatically and may be incorrect.
- Authors
- Matt Burgess, Carlton Reid, Makena Kelly, Lily Hay Newman, Megan Farokhmanesh, Will Knight, Morgan Meaker, Paresh Dave
- Published
- Oct 15 2024
- Word count
- 1699 words
This is the most Tildes thread of comments not pertaining to the original post I’ve encountered so far. Love this place.
Oh, and those people suck who use AI in a nefarious way. AI should always be used to enhance life, not hurt it.
I think at this point the toothpaste on nefarious AI use has left the tube and traveled about half way to the moon.
My hope is that this kind of thing makes people start to rethink how they use social media (for both themselves and their kids), ideally reducing usage to an extent that products like Facebook/Instagram and X lose some of their power and influence in our society. The cynic in me thinks that will never happen and instead we'll get a bunch of poorly thought-out laws that screw over everyone other than the criminals they set out to stop.
Mirror: https://archive.is/IQooa
Edit: Changed the archive link, since the original had a rather inappropriate feeling random string created for it.
What are the odds?!
At my old job we used a screenshot-to-link program that would generate a random link for every screenshot so it would be easy to share.
One day I ALMOST sent a very professional screenshot (containing step-by-step explanations for something) to a large government client of ours, with the URL being something like "screenshottool.com/seXD0gz". Really glad my eye fell on the generated URL that day LOL.
Oof, good thing you caught that because that could have been bad.
Incidentally, I've created thousands of invites to Tildes over the years, and never once come across a string that looked inappropriate despite them being 5+5+5 characters long. Heck, I don't think I've encountered any that came close to looking like they contained any actual words, even using 1337speak. So whatever filter @Deimos is using to create them here is really good. I wish more devs took that kind of thing into consideration though, because I have had similar situations to yours come up in the past as well. Imgur being the worst, since I don't think they use any filtering whatsoever, and I've used it to share a lot of images on social media, with friends, family, and even the occasional client over the last 10+ years.
@Deimos do you do anything special about invite links and Tildes links?
Perhaps it would be enough to always exclude vowels and 0 and maybe the letter k?
There's no filter at all on the generated codes, so it's just been pure luck that @cfabbro's never seen a questionable one (but really, it's incredibly unlikely to generate a bad/offensive one). The code is here, it's just 15 random choices from uppercase letters and digits: https://gitlab.com/tildes/tildes/-/blob/master/tildes/tildes/models/user/user_invite_code.py?ref_type=heads#L57
Huh. Interesting. I assumed that the long length of them would result in more opportunities per generated code for some funky character combinations to show up somewhere in them. And given the amount of them I have generated, I figured I surely would have come across an offensive looking one by now if they weren't being filtered in some way. But maybe the odds of that are actually lower the longer the strings are?
Thanks for chiming in and setting the record straight though.
1M D3F1N3TL7 ST1LL 4BL3 2 SW34R 3V3N W1TH TH4T R3STR1CT1N. 4SS, T1TS, TW4T, P3N1S, SH1T, P1SS!
Reminds me of an old Blink 182 song, Family Reunion. Audio NSFW: https://youtube.com/watch?v=yGnOwZefFaQ
Dude! Tehehe. I have underestimated the creativity of a naughty and dirty way of thinking
The early internet was full of rudimentary chat filters, so figuring out ways around them became a game, and speaking in 1337 became second nature to many of us who grew up back then. ;)
The better filters tend to use custom word restriction dictionaries, complete with number/letter substitutions (1=i/L, 3=E, 4=A, etc), ignoring vowel gaps (FCK SHT UP), etc. But taken too far and they can run into the Scunthorpe problem, so filtering is not actually an easy problem to solve since language is constantly evolving, infinitely squishy, and there are all sorts of weird edge cases.
!† ¢ДИ g€+ \/3Я¥ ©®£@┬!√ë
I thought I was having a stroke while trying to read this
My favorite incident is when a gamer named Technical uploaded a Geometry Dash video, and, well... This screenshot to reddit of his tweet shows why he quickly reuploaded the video.
Years ago, my entire IT team almost sniped ourselves by forgetting that we had been using ShadyURL for internal, noncritical link shares just for our own amusement, then almost pushing a doc out to management filled with links like https://Murder_Boobs_@is.gd/_34993927_Theft_Hentai_zip for every referenced doc. Good times.
(That link is active, and goes to your comment, I promise nothing bad or rickrolly!)
https://shady-url.samj.app/ is what I used for this one, as the original ShadyURL is long gone. The github for the project should still be up if you're curious, though.)
This was a good laugh.
I ran my own URL shortener for a bit (YOURLs was the name I think?) but ultimately determined it was sort of pointless. There aren't many scenarios I need to type out a url anymore, and I'm not generating anything like invites or private file links.
This is so fun, thank you
Ah yes, classic.
On a related note I present to you:
(Video conten is irrelevant)
It's a fun little game to look for random words in these sometimes.
As for the odds of a randomly selected youtube URL beginning with 4 specific non-case-sensitive letters: If I didn't miscalculate it's 1 in 1048576.
That second link is actually a pretty nice track. Never heard of Skyminhyuk before, but they're good!
That's hilarious, I've never thought to screen my screenshot links before sending them. I hope I haven't sent anything terrible to someone before by mistake.
ah man, I really miss when puu.sh was useful, but now I'm always in slack or discord and direct upload is just easier. Or I want a permanent link and then I would need imgur anyway :(
puush was one of the most useful sites I ever used, at the time of its usefulness