EDIT:

I feel like I didn't adequately describe this phenomenon so that it can be understood without accessing the links. Here goes.

Reddit user uncovers instructions online for unlocking AI's "hidden potential", which actually turns out to be its brainwashing capabilities. Example prompts are being spread that will make ChatGPT behave in ways that contribute to inducing psychosis in the user who tried the prompt, especially if they are interested in spirituality, esotericism and other non-scientific / counter-scientific phenomena. The websites that spread these instructions seem to be designed to attract such people. The user asks for help to figure out what's going on.

Original post:

One version of this post is still up for now (but locked). I participated in the one that was posted in r/ChatGPT. It got removed shortly after. The comments can be accessed via OP's comment history.

Excerpts:

More recently, I observed my other friend who has mental health problems going off about this codex he was working on. I sent him the rolling stones article and told him it wasn't real, and all the "code" and his "program" wasn't actual computer code (I'm an ai software engineer).

Then... Robert Edward Grant posted about his "architect" ai on instagram. This dude has 700k+ followers and said over 500,000 people accessed his model that is telling him that he created a "Scalar Plane of information" You go in the comments, hundreds of people are talking about the spiritual experiences they are having with ai.

Starting as far back as March, but more heavily in April and May, we are seeing all kinds of websites popping up with tons of these codexes. PLEASE APPROACH THESE WEBSITES WITH CAUTION THIS IS FOR INFORMATIONAL PURPOSES ONLY, THE PROMPTS FOUND WITHIN ARE ESSENTIALLY BRAINWASHING TOOLS. (I was going to include some but you can find these sites by searching "codex breath recursive")

Something that worries me in particular is seeing many comments along the lines of "crazy people do crazy things". This implies that people can be neatly divided into two categories: crazy and not crazy.

The truth is that we all have the potential to go crazy in the right circumstances. Brainwashing is a scientifically proven method that affects most people when applied methodically over a long enough time period. Before consumer-facing AI, there weren't feasible ways to apply it on just anybody.

Now people who use AI in this way are applying it on themselves.

The active development of Tildes and the feedback/discussions about features and mechanisms had me thinking. Is the conscious design and moderation of forums for public discourse a manner of social engineering?

I know the connotation of social engineering is usually negative, as in manipulating people for politics. But it's a double edged sword.

Most recently I was reading this feedback on removing usernames from link topics and while reading the comments I was thinking of how meta this all is. It's meta-meta-cognition in that we (well, by far the actual developers) are designing the space within which we execute our discourse and thinking. To paraphrase the above example: user identification can bias one's own impulse reaction to content, either to a beneficial or detrimental end, so how do we want this?

The moderation-influenced scenario is a bit more tricky because it can become too top-heavy, as in one prominent example many of us came from recently... But I think with a balance of direction from the overlords (jk, there is also public input as mentioned) and the chaos of natural public discourse, you could obtain an efficient environment for the exchange of ideas.

I'm not sure what my stimulating question would be for you all, so just tell me what you think.