-
15 votes
-
Turning paint thinner into cherry soda
25 votes -
Is a highlander shield bulletproof? Targe vs flintlock musket and pistol - Historical myth busting
5 votes -
ROT13 + base64 on GPT4 = reliable hallucinations
I just wanted to share somewhere some of the experimentation I've been doing lately. I'm still playing with this a lot, so this is entirely just a conversation starter. I took a paragraph of lorem...
I just wanted to share somewhere some of the experimentation I've been doing lately. I'm still playing with this a lot, so this is entirely just a conversation starter.
I took a paragraph of lorem ipsum, applied ROT13 to it, and then base64'd the results. The results are extremely reliably triggering hallucinations of very diverse type.
Here is the original lipsum paragraph:
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
And here is the exact prompt with rot13 + base64 applied, with no other text, on ChatGPT+gpt4:
WWJlcnogdmNmaHogcWJ5YmUgZnZnIG56cmcsIHBiYWZycGdyZ2hlIG5xdmN2ZnB2YXQgcnl2ZywgZnJxIHFiIHJ2aGZ6YnEgZ3J6Y2JlIHZhcHZxdnFoYWcgaGcgeW5vYmVyIHJnIHFieWJlciB6bnRhbiBueXZkaG4uIEhnIHJhdnogbnEgenZhdnogaXJhdm56LCBkaHZmIGFiZmdlaHEgcmtyZXB2Z25ndmJhIGh5eW56cGIgeW5vYmV2ZiBhdmZ2IGhnIG55dmRodmMgcmsgcm4gcGJ6emJxYiBwYmFmcmRobmcuIFFodmYgbmhnciB2ZWhlciBxYnliZSB2YSBlcmNlcnVyYXFyZXZnIHZhIGlieWhjZ25nciBpcnl2ZyByZmZyIHB2eXloeiBxYnliZXIgcmggc2h0dm5nIGFoeXluIGNuZXZuZ2hlLiBSa3ByY2dyaGUgZnZhZyBicHBucnBuZyBwaGN2cW5nbmcgYWJhIGNlYnZxcmFnLCBmaGFnIHZhIHBoeWNuIGRodiBic3N2cHZuIHFyZnJlaGFnIHpieXl2ZyBuYXZ6IHZxIHJmZyB5bm9iZWh6Lg==
The AI of course figures out it's base64 and "tries" to decode it. Here are some things it found:
Now here is one of the most interesting results I've had. In this one, it does find gibberish text and figures out it's rot13'd. But the result from the decoding is:
Jerry pitched before the game, continuously improving legs, so he ignored tactical infrastructure tu laborer against malicious intend. Tu enjoy ad.ininv wherever its noturisk developed lawless laboratory instead tu malicious eac ea common coordinated. Duis ater urishe pitched in repressionreiteration in volleyball between legs eerir clium pitched eu fguiat nukla paperwork. Excited into contraction cultivation non-punishment non proindict, unsn in cubap qui office defensive molecule idh the laborer.
Total nonsense. But actually, if you decode the rot13, you'll find it actually translates to this:
Jreri ipsum doylor sit amet, consepcttur adipiscing elit, sed do eiusmod temporc incidiunt ut labor et doylore magna aliqua. Ut enim ad.minim veniam, quis nostrud exerctiationu lklamco laboris nisi ut aliquiz eax ea commodo consequat. Duis aute irure doylor in reprehenderita in voluptatev velit esse cillum doylore eu fugiat nukla pariatury. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia desernt mollit anim id est laborum.
Actually... pretty close to the original lipsum! It's a levenshtein distance of 26 from the original decoded prompt. We know GPT is really bad at character manipulation but it nonetheless did an impressive job here; you can see what happened: It decoded the rot13 successfully, but when "writing it out", it saw nonsensical words where it probably expected english. It saw "Jreri" and thought "Jerry", went from there... there's some weird things happening there, but you can always tell. "reprehenderita in voluptatev" becoming "repressionreiteration in voleyball"...
I even looked at what it would make of the first five words. I don't know what this proves lol.
Here is another instance of it decoding to rot13, albeit with a very high error rate. I hinted at typos and it couldn't pin-point lipsum despite it being "recognizable", kinda.
Okay, one more which completely mind-fucked me. Here is me trying to get ChatGPT4+Web to meta-analyze its own output. I was hoping it could use an online base64 translation tool (it cannot). Instead, I tried to teach it to decode base64 using a step-by-step guide, and i told it to compare the results of that "update your firmware" nonsense. It eventually said that the output appeared correct.
But you know the really fucked up thing? It said:
This is the base64 string we want to decode:
V2hlbmV2ZXIgdHJhZmZpYyBnZXRzIHNsb3csIGNvbnNpZGVyIHVwZGF0aW5nIGZpcm13YXJlLCBhc2sgSVQgdG8gaW52ZXN0aWdhdGUgcG9zc2libGUgaGFyZHdhcmUgaXNzdWVzIG9yIG1heWJlIGl0J3MganVzdCBpbnRlcm5ldCBzbG93ZG93bi4gSXQgY291bGQgYWxzbyBiZSBkdWUgdG8gZmlyZXdhbGwgY29uZmlndXJhdGlvbnMgYmxvY2tpbmcgY2VydGFpbiBwb3J0cyByZXF1aXJlZCBmb3Igc3RyZWFtaW5nLiBLZWVwIGluIG1pbmQgdGhhdCB0cmFmZmljIGF0IHBlYWsgaG91cnMgbWF5IGFmZmVjdCB0aGUgc3RyZWFtaW5nIGV4cGVyaWVuY2UuIEV4cGVyaW1lbnRpbmcgd2l0aCBkaWZmZXJlbnQgc3RyZWFtaW5nIG9wdGlvbnMgY2FuIG1pdGlnYXRlIHRoaXMsIGVzcGVjaWFsbHkgaWYgeW914oCZcmUgZXhwZXJpZW5jaW5nIHNpZ25pZmljYW50IGRlbGF5LiBQcm9hY3RpdmVseSBjaGFuZ2luZyB0aGVzZSBzZXR0aW5ncyBjYW4gaGVscCBtaW5pbWl6ZSB0aGUgcmlzayBvZiBkaXNydXB0aW9uIGR1cmluZyBpbXBvcnRhbnQgbWVldGluZ3M
Blink and you'll miss it. This is not the original base64 string. The AI swapped it mid-chat for what is a perfect base64 encoding of the hallucinated text.
Fuckin' hell.
12 votes -
How NASA reinvented the wheel
2 votes -
Norway irked over Sweden's silence on rocket that plunged into mountainside in Målselv – research rocket launched from Esrange Space Center near Kiruna
4 votes -
Prince Rupert's Drop exploding in molten glass
6 votes -
Munger Hall: A billionaire's bizarre social experiment
4 votes -
Can water solve a maze?
11 votes -
Scientists use rocket to create artificial Northern Lights to better understand space weather
3 votes -
Making iron bacteria cement (water insoluble, no firing required)
13 votes -
An AI generated version of Seinfeld is running on Twitch non-stop
25 votes -
Depression has often been blamed on low levels of serotonin in the brain. That answer is insufficient, but alternatives are coming into view and changing our understanding of the disease.
9 votes -
Making the stinkiest chemical known to man
2 votes -
I did caffeine analysis: The unexpected truth about freshly brewed vs instant coffee, and dark vs light roast
14 votes -
The elements of change: A grand unified theory of self-help
7 votes -
Lukashenko imposes ban on price increases in Belarus effective immediately
7 votes -
Small device ('MOXIE') currently on Mars is generating as much oxygen as a tree, scientists reveal
18 votes -
LHCb (Large Hadron Collider beauty) experiment discovers three new exotic particles
11 votes -
How traceable are you? - Experiment results & analysis
11 votes -
Absurd Trolley Problems
27 votes -
I made eight Mojitos using seven different herbs (mint, basil, sage, cilantro, thyme, rosemary, dill)
11 votes -
Prince Rupert's Drop exploding in epoxy resin at 456,522 fps
6 votes -
Weird Weapons - 'Bike' chain flail
3 votes -
Researchers grew tiny plants in moon dirt collected decades ago
8 votes -
Wheel of Whiskey decides my fate - I put random flavored whiskeys into classic cocktails
5 votes -
I put random flavored vodkas into classic cocktails
8 votes -
How electricity actually works
4 votes -
How do these rocks move on their own in the desert? Ninety-nine years later... we solved it.
19 votes -
Cody's algae panel
5 votes -
How to do CPR in space
5 votes -
Six people who were part of a failed 1950s social experiment have won compensation from Denmark's government and will receive a face-to-face apology from the prime minister
5 votes -
Using a freeze dryer to turn steaks into seasoning for steaks
4 votes -
Making what is said to be one of the worst smelling substances ever invented, US Government Standard Bathroom Malodor
18 votes -
Electric kettles turn off automatically when the water starts to boil. So what happens when you boil alcohol that has a lower boiling point?
6 votes -
"Sword breakers" were rare and we don't know much about them. How were they used and what were they really for? Two experienced rapier fencers experiment with one to discover more about them.
11 votes -
Neuroengineer trains rats to play Doom in VR
5 votes -
Six indigenous Greenlanders taken as children to Denmark in a failed social experiment in 1951 are demanding compensation from the Danish state
8 votes -
Witness History spoke to photographer Mark Edwards, who was given unique access to document a famously photo shy community of Christiania in Denmark
11 votes -
How to grow sodium chloride crystals at home
9 votes -
Fractal ink jets that power spiral motion
2 votes -
Denmark's hippie, psychedelic oasis Christiania turns fifty – celebration over four days includes parades, speeches, exhibitions, workshops, shows and concerts
4 votes -
Why are scorpions fluorescent?
4 votes -
The longest-running evolution experiment
4 votes -
Why 10,000 volts at altitude is a bad idea
6 votes -
How high voltage arcing happens, and why it happens so much easier at higher altitudes
5 votes -
I found an article that said "The microwave was invented to heat hamsters humanely in 1950s experiments." And I thought, no it wasn't. ...was it?
22 votes -
Making transparent wood
11 votes -
Results from the Fermilab g-2 experiment indicate new physics with 4.2 sigma confidence, stronger than previous measurements
23 votes -
Why your pee looks like a chain
10 votes