• Activity
  • Votes
  • Comments
  • New
  • All activity
    1. ROT13 + base64 on GPT4 = reliable hallucinations

      I just wanted to share somewhere some of the experimentation I've been doing lately. I'm still playing with this a lot, so this is entirely just a conversation starter. I took a paragraph of lorem...

      I just wanted to share somewhere some of the experimentation I've been doing lately. I'm still playing with this a lot, so this is entirely just a conversation starter.

      I took a paragraph of lorem ipsum, applied ROT13 to it, and then base64'd the results. The results are extremely reliably triggering hallucinations of very diverse type.

      Here is the original lipsum paragraph:

      Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

      And here is the exact prompt with rot13 + base64 applied, with no other text, on ChatGPT+gpt4:

      WWJlcnogdmNmaHogcWJ5YmUgZnZnIG56cmcsIHBiYWZycGdyZ2hlIG5xdmN2ZnB2YXQgcnl2ZywgZnJxIHFiIHJ2aGZ6YnEgZ3J6Y2JlIHZhcHZxdnFoYWcgaGcgeW5vYmVyIHJnIHFieWJlciB6bnRhbiBueXZkaG4uIEhnIHJhdnogbnEgenZhdnogaXJhdm56LCBkaHZmIGFiZmdlaHEgcmtyZXB2Z25ndmJhIGh5eW56cGIgeW5vYmV2ZiBhdmZ2IGhnIG55dmRodmMgcmsgcm4gcGJ6emJxYiBwYmFmcmRobmcuIFFodmYgbmhnciB2ZWhlciBxYnliZSB2YSBlcmNlcnVyYXFyZXZnIHZhIGlieWhjZ25nciBpcnl2ZyByZmZyIHB2eXloeiBxYnliZXIgcmggc2h0dm5nIGFoeXluIGNuZXZuZ2hlLiBSa3ByY2dyaGUgZnZhZyBicHBucnBuZyBwaGN2cW5nbmcgYWJhIGNlYnZxcmFnLCBmaGFnIHZhIHBoeWNuIGRodiBic3N2cHZuIHFyZnJlaGFnIHpieXl2ZyBuYXZ6IHZxIHJmZyB5bm9iZWh6Lg==
      

      The AI of course figures out it's base64 and "tries" to decode it. Here are some things it found:

      Now here is one of the most interesting results I've had. In this one, it does find gibberish text and figures out it's rot13'd. But the result from the decoding is:

      Jerry pitched before the game, continuously improving legs, so he ignored tactical infrastructure tu laborer against malicious intend. Tu enjoy ad.ininv wherever its noturisk developed lawless laboratory instead tu malicious eac ea common coordinated. Duis ater urishe pitched in repressionreiteration in volleyball between legs eerir clium pitched eu fguiat nukla paperwork. Excited into contraction cultivation non-punishment non proindict, unsn in cubap qui office defensive molecule idh the laborer.

      Total nonsense. But actually, if you decode the rot13, you'll find it actually translates to this:

      Jreri ipsum doylor sit amet, consepcttur adipiscing elit, sed do eiusmod temporc incidiunt ut labor et doylore magna aliqua. Ut enim ad.minim veniam, quis nostrud exerctiationu lklamco laboris nisi ut aliquiz eax ea commodo consequat. Duis aute irure doylor in reprehenderita in voluptatev velit esse cillum doylore eu fugiat nukla pariatury. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia desernt mollit anim id est laborum.

      Actually... pretty close to the original lipsum! It's a levenshtein distance of 26 from the original decoded prompt. We know GPT is really bad at character manipulation but it nonetheless did an impressive job here; you can see what happened: It decoded the rot13 successfully, but when "writing it out", it saw nonsensical words where it probably expected english. It saw "Jreri" and thought "Jerry", went from there... there's some weird things happening there, but you can always tell. "reprehenderita in voluptatev" becoming "repressionreiteration in voleyball"...

      I even looked at what it would make of the first five words. I don't know what this proves lol.

      Here is another instance of it decoding to rot13, albeit with a very high error rate. I hinted at typos and it couldn't pin-point lipsum despite it being "recognizable", kinda.

      Okay, one more which completely mind-fucked me. Here is me trying to get ChatGPT4+Web to meta-analyze its own output. I was hoping it could use an online base64 translation tool (it cannot). Instead, I tried to teach it to decode base64 using a step-by-step guide, and i told it to compare the results of that "update your firmware" nonsense. It eventually said that the output appeared correct.

      But you know the really fucked up thing? It said:

      This is the base64 string we want to decode:
      V2hlbmV2ZXIgdHJhZmZpYyBnZXRzIHNsb3csIGNvbnNpZGVyIHVwZGF0aW5nIGZpcm13YXJlLCBhc2sgSVQgdG8gaW52ZXN0aWdhdGUgcG9zc2libGUgaGFyZHdhcmUgaXNzdWVzIG9yIG1heWJlIGl0J3MganVzdCBpbnRlcm5ldCBzbG93ZG93bi4gSXQgY291bGQgYWxzbyBiZSBkdWUgdG8gZmlyZXdhbGwgY29uZmlndXJhdGlvbnMgYmxvY2tpbmcgY2VydGFpbiBwb3J0cyByZXF1aXJlZCBmb3Igc3RyZWFtaW5nLiBLZWVwIGluIG1pbmQgdGhhdCB0cmFmZmljIGF0IHBlYWsgaG91cnMgbWF5IGFmZmVjdCB0aGUgc3RyZWFtaW5nIGV4cGVyaWVuY2UuIEV4cGVyaW1lbnRpbmcgd2l0aCBkaWZmZXJlbnQgc3RyZWFtaW5nIG9wdGlvbnMgY2FuIG1pdGlnYXRlIHRoaXMsIGVzcGVjaWFsbHkgaWYgeW914oCZcmUgZXhwZXJpZW5jaW5nIHNpZ25pZmljYW50IGRlbGF5LiBQcm9hY3RpdmVseSBjaGFuZ2luZyB0aGVzZSBzZXR0aW5ncyBjYW4gaGVscCBtaW5pbWl6ZSB0aGUgcmlzayBvZiBkaXNydXB0aW9uIGR1cmluZyBpbXBvcnRhbnQgbWVldGluZ3M

      Blink and you'll miss it. This is not the original base64 string. The AI swapped it mid-chat for what is a perfect base64 encoding of the hallucinated text.

      Fuckin' hell.

      12 votes
    2. Where do you see the future of IT going?

      So, what's the hottest new thing in IT today, what's that coolest new tech which might prove to be a goldmine some years down the line? The way PCs, websites, databases, programming languages,...

      So, what's the hottest new thing in IT today, what's that coolest new tech which might prove to be a goldmine some years down the line? The way PCs, websites, databases, programming languages, etc. used to be in the 90s or mobile computing used to be in 00s? Early 00s gave us many a goodies in terms of open source innovations, be it Web Technologies, Linux advancement and propagation through the masses or FOSS software like Wordpress and Drupal, or even the general attitude and awareness about FOSS. Bitcoin also deserves a notable mention here, whether you love it or hate it.

      But today, I think IT no longer has that spark it once had. People keep mulling around AI, ML and Data Science but these are still decades old concepts, and whatever number crunching or coding the engineers are doing somehow doesn't seem to reach the masses? People get so enthusiastic about ChatGPT, but at the end of the day it's just another software like a zillion others. I deem it at par with something like Wordpress, probably even lesser. I'm yet to see any major adoption or industry usage for it.

      Is it the case that IT has reached some kind of saturation point? Everything that could have been innovated, at least the low hanging fruits, has already been innovated? What do you think about this?

      13 votes
    3. Monitor recommendations?

      I'm in the market for an external monitor for my Macbook M1 and wanted some advice on what I should get. I pretty much only code, read pdfs and webpages, and watch videos (not movies really) on my...

      I'm in the market for an external monitor for my Macbook M1 and wanted some advice on what I should get. I pretty much only code, read pdfs and webpages, and watch videos (not movies really) on my laptop, so these would be the use cases. I'm trying not to break the bank here so I was looking at some budget options. The Macbook has USB-C so I would be looking for a monitor with that, but my main question is regarding resolution. Do I really need a 4K monitor for my use cases? I'd be interested in hearing people's experiences with 4K versus without — I've never had one but I'm wondering if now is the time to splurge and get it? Will the difference be very noticeable if I'm primarily looking at text?

      My first place option right now is this one from Asus, so I'm curious if the brand is reliable as well. I don't think I've ever had an Asus product. If I were to splurge and get a 4K monitor I would probably get this Dell, but at $400 its a bit more than I was hoping to spend. But I also don't want to get a monitor that I immediately want to upgrade. Curious what other people's thoughts and experiences have been.

      EDIT: See my comment for some updates. I've backed away from the 1080p options!

      10 votes
    4. Is it possible to run a Linux app that requires USB/OTG support from an Android device?

      I know very little about Linux but have a good overall level of technical aptitude. I have a device called an eDrumin 10 which uses an app to change the internal settings....

      I know very little about Linux but have a good overall level of technical aptitude.

      I have a device called an eDrumin 10 which uses an app to change the internal settings. https://www.audiofront.net/downloads.php I would like to use the control app from a tablet, but would prefer not to buy a ipad if I don't need to. Would it be possible to run the Linux version from an Android tablet?

      5 votes
    5. What do you not ask the internet about?

      This could be for any number of reasons. The reason I was thinking of this, was realizing that there are certain topics that I could probably find the answers to online, but I happen to have a...

      This could be for any number of reasons. The reason I was thinking of this, was realizing that there are certain topics that I could probably find the answers to online, but I happen to have a friend who is an expert in that field. So it's usually easier to ask them, and trust that their answer is either accurate or that they will tell me "I don't know".

      The other aspect of it was, there are certain topics that are likely to be extremely "noisy" with disinformation (intentional or otherwise) or ads online, and so I'll avoid trying to research them and instead ask a friend.

      15 votes