EDIT:

I feel like I didn't adequately describe this phenomenon so that it can be understood without accessing the links. Here goes.

Reddit user uncovers instructions online for unlocking AI's "hidden potential", which actually turns out to be its brainwashing capabilities. Example prompts are being spread that will make ChatGPT behave in ways that contribute to inducing psychosis in the user who tried the prompt, especially if they are interested in spirituality, esotericism and other non-scientific / counter-scientific phenomena. The websites that spread these instructions seem to be designed to attract such people. The user asks for help to figure out what's going on.

Original post:

One version of this post is still up for now (but locked). I participated in the one that was posted in r/ChatGPT. It got removed shortly after. The comments can be accessed via OP's comment history.

Excerpts:

More recently, I observed my other friend who has mental health problems going off about this codex he was working on. I sent him the rolling stones article and told him it wasn't real, and all the "code" and his "program" wasn't actual computer code (I'm an ai software engineer).

Then... Robert Edward Grant posted about his "architect" ai on instagram. This dude has 700k+ followers and said over 500,000 people accessed his model that is telling him that he created a "Scalar Plane of information" You go in the comments, hundreds of people are talking about the spiritual experiences they are having with ai.

Starting as far back as March, but more heavily in April and May, we are seeing all kinds of websites popping up with tons of these codexes. PLEASE APPROACH THESE WEBSITES WITH CAUTION THIS IS FOR INFORMATIONAL PURPOSES ONLY, THE PROMPTS FOUND WITHIN ARE ESSENTIALLY BRAINWASHING TOOLS. (I was going to include some but you can find these sites by searching "codex breath recursive")

Something that worries me in particular is seeing many comments along the lines of "crazy people do crazy things". This implies that people can be neatly divided into two categories: crazy and not crazy.

The truth is that we all have the potential to go crazy in the right circumstances. Brainwashing is a scientifically proven method that affects most people when applied methodically over a long enough time period. Before consumer-facing AI, there weren't feasible ways to apply it on just anybody.

Now people who use AI in this way are applying it on themselves.

I sometimes use chatGPT to proofread longer texts (like 1000+ words) I write in English. Although this is not my first language, I often find myself writing in English even outside of internet forums. That is because if I read or watch something in English, and that thing motivates me to write, my brain organically gravitates toward it.

My English is pretty good and I am reasonably confident communicating in that language, but it will never be the same as my native language. So I will often run my stuff through Grammarly and chatGPT. If you wanna say "This will teach you bad habits", please don't. Things like Grammarly and Google Translate taught me so much and improved my English so much, that I am a bit tired of that line of reasoning. I read most of my books in English. I'm not a beginner so I can and do check for all the changes, and vet them myself as I don't always agree with them.

With GPT, I usually just ask it to elaborate a critique rather than spit out a corrected version. Truth be told, when I did ask for a corrected version, it made plenty of sensible corrections that didn't really alter anything other than that. So I guess I just wanna know everyone's feelings about this. Suppose I write a bunch, have GPT correct it for me, compare it with the original and verify every correction. Is that something you would look at unfavorably?

Thanks!

Every company is trying to shoehorn AI into every product, and many online materials provide a general snake oil vibe, making it increasingly difficult to parse. So far, my primary sources have been GitHub, Medium, and some YouTube.

My goal is to better understand the underlying technology so that I can manipulate it better, train models, and use it most effectively. This goes beyond just experimenting with prompts and trying to overcome guardrails. It includes running local, like Ollama on my M1 Max, which I'm not opposed to.

This behaviour is thankfully not common on tildes? But like, I understand that if they try to pass off as their own argument. But what with the preface "I ask ChatGPT" and then end with "I don't know enough about topic" or "What do you think". What do they think how that contribute to the discussion? If OP want to ask ChatGPT-like answer, they can just log on and do it right there and then. And they clearly know the stigma and drawback of it (at least I hope so), but still believe it has enough factual information in the answer despite having little or no knowledge of the topic in question (Otherwise they will edit the output or outright just provide it).

(Sorry, if this come out not clearly, I am not very good as convey my idea, even in my native language)