In all the hype and debate and excitement and frustration around AI, I think sometimes the fact that we've achieved something really cool gets lost. I want to talk about that a bit, which I'll try to do in a simple way, without too much math or computer science.

There's a surprising amount of intelligence encoded in applied language. To me that's the most remarkable insight in LLM technology. Except it's not really surprising at all. The whole point of language is to encode intelligence. Communication, at its core, is about sharing intelligence. LLMs agents are a way of turning the intelligence encoded in language, particularly written language, into useful work.

You might imagine that language is just the starting point when building LLMs. That it gets converted into computer stuff and then it's not language anymore. But in a way it's language all the way down. Distill language into math and then run gradient descent on it and the intelligence (for lack of a better term) bubbles out.

Forgive that hyperbole, but there is something a little bit magical about it, and the technology is entirely unmagical. The magic is in the language.

At the core the tech is pretty simple. First you go and get all of the language. Just completely idiotic amounts of applied language. Because there's a threshold: if you don't use enough language you don't get a useful result. The more language you use, assuming it's good quality, the more useful the result.

After you have all of the language, you convert it into tokens, which are essentially pieces of words represented as numbers. You also compute a compressed version of the relationships between the tokens. The frontier labs don't say how much this costs publicly anymore but it's safe to say hundreds of millions in compute are required for this process. Each time you do it.

Once you've determined the token relationships, you've pre trained an LLM. You have the initial weights. At this point your LLM can output credible prose pretty reliably when you run inference on the weights. Meaning that you can take a given set of language tokens (a prompt) and determine which token should come next, over and over again, until you have a response. The fluency of the prose can be uncanny, and there are latent tendencies towards useful output, but you can't really do much with it yet.

The next step, fine tuning, modifies the weights in order to nudge the inference towards useful things like instruction following, tool use and reasoning. Or a simulacrum of reasoning. Fine tuning is a massive, multi step, iterative process that turns your LLM into a useful tool that can do more than output believable prose.

Something that's really fascinating to me about fine tuning is that what you're training is still the language relationship weights, and what comes out during inference is still language. But now it's language that is more likely to result in useful output and behaviors. Language is the substrate that LLMs reason through. A model that's more likely to infer the words "but what if I look at it another way" is more likely to consider multiple possibilities. A model that reliably infers language around tool use in appropriate situations is an agent. The behavior is encoded in the language.

After tens of millions in fine tuning costs, assuming you got it right, you have the core of a LLM that can function as an AI agent. You can put it in a harness and ask it to do things in the language of your choice and it will actually be able to do them a shockingly high percentage of the time. It can even do things that weren't explicitly part of the training. That's something which has never happened before outside of science fiction. Until recently it was one of those computer sciencey things that was probably going to happen someday, after we were all dead.

It sucks that this tech revolution is being driven by the capital class, and that it's happening as a mad dash for market domination and golden IPOs. In a more perfect world technology derived from collective human intelligence would be a public good rather than a profit driver.

But nevertheless, the ability to imprint some part of human intelligence into an autonomous agent is a remarkable achievement. One that we can't yet see the full size of. And it's possible not because we typed instructions into an interface, but because we've spent centuries encoding our intelligence into language.

I'm looking to replace my current mechanical keyboard which has a few problems. If anyone has recommendations I would appreciate it.

Here is what I'm looking for:

• Mechanical switches
• USB C and bluetooth.
• Smaller size (no keypad)
• Clicky but not too loud. I think I currently have "brown" switches which are good.
• Backlit (but not colorful unless I'm able to set it to something muted or single-colored)
• Works with mac, pc, linux, and maybe tablets

I don't care very much if there is a battery in the unit as long as it can switch to bluetooth while plugged into usb.

I went to mechanicalkeyboards.com and looked around and got a bit overwhelmed. Looks like the prices are mostly under $200 which would be ok.

What went wrong with my current keyboard:
It's an EPOMAKER TH80 pro. The size is good, the features are good, and the keyboard feel is good. But the battery went dead so it has to be plugged in all of the time, and several of the keys get double presses at random so I have to backspace a lot.

Thanks!

Add awesome game deals to this topic as they come up over the course of the week!

Alternately, ask about a given game deal if you want the community’s opinions: e.g. “What games from this bundle are most worth my attention?”

Rules:

• No grey market sales
• No affiliate links

If posting a sale, it is strongly encouraged that you share why you think the available game/games are worthwhile.

All previous Save Point topics

If you don’t want to see threads in this series, add save point to your personal tag filters.

I did a search and the last time this was posted about was nearly two years ago. I don't know if there have been any updates on the subject since then.

I see that there is a ublock filter suggested on the wiki, but that is not an option on some of the devices that I use to browse tildes.

Edit: Anyone who thinks it might be them, yes it is very specifically you. All of you. You know what you did. :)

Well, the time is about up for this month's CGA, so I hope everyone that gave Lufia II a shot enjoyed it and defeated the Sinstrals forever. JK, it's a prequel, we know they came back :)

Please feel free to talk freely about the game in the comments and let everyone know how far you got, what you liked, and what you didn't.

I was able to finish the game and I beat the ancient cave (my true goal) on my second attempt. Did anyone else give the ancient cave a try?

Our next host is u/Boojum with the amazing game The Legend of Zelda: A Link to the Past. I'm super excited about this one, even though I've played it a dozen times, as it is my favorite Zelda game.

What have you been listening to this week? You don't need to do a 6000 word review if you don't want to, but please write something! If you've just picked up some music, please update on that as well, we'd love to see your hauls :)

Feel free to give recs or discuss anything about each others' listening habits.

You can make a chart if you use last.fm:

http://www.tapmusic.net/lastfm/

Remember that linking directly to your image will update with your future listening, make sure to reupload to somewhere like imgur if you'd like it to remain what you have at the time of posting.

Server host: tildes.nore.gg (Running Java 26.2)
Verification site: https://tildes.nore.gg
BlueMap: https://tildes.nore.gg/map/
Patreon: https://www.patreon.com/TildesMC

The server operates on a soft whitelist. Anyone can log in and walk around, but you need a Tildes account to gain build access.

We recommend you install our mod web-chat so that you can chat while in your web browser. It turns the server into an old-school chat room.

<- Previous Thread

I've been slowly convincing myself that I want to go to Africa, mostly because I haven't done a solo trip in a while, but also because I haven't been to Africa at all yet! Some of my team members are in Ghana and they sent me pictures of it, and it looked amazing. I definitely would love to go! I'm thinking of going during the week of Christmas only because it's probably my only time I'm available for the rest of the year. Any tips or places that I should be looking at?

(I also have some Scandinavian countries, Prague, or Scotland/Ireland on my docket, but I've been to Europe so much these last couple of years and I figure I'd need something new)

Tildes is a very serious site, where we discuss very serious matters like work life balance, optimism and gog.galaxy. Tags culled from the highest voted topics from the last seven days, if anyone was a frequent flyer.

But one of my favourite tags happens to be offbeat! Taking its original inspiration from Sir Nils Olav III, this thread is looking for any far-fetched offbeat stories lurking in the newspapers. It may not deserve its own post, but it deserves a wider audience!

Not sure where this goes but I am looking for an app to help fill in between other reading practice we do with our 5 year old.

This won't be the main tool to help them learn, just trying to find something fun to help learn a bit. Does anyone have recommendations for fun and educational reading apps?

As part of a weekly series, these topics are a place for users to casually discuss the things they did — or didn't do — during their week. Did you accomplish any goals? Suffer a failure? Do nothing at all? Tell us about it!

Hi
Seems we need to compile jpegli from git.

https://github.com/google/jpegli

I'm not able to do this at present.
Maybe a tildean person here is. :-)

I want to experiment and compare results with my installed mozjpeg.

Anybody know where there is a jpegli precompiled?
Something to drop into Linux usr/local/bin.
Or a windows executable to use with wine.

Blogpost... https://opensource.googleblog.com/2024/04/introducing-jpegli-new-jpeg-coding-library.html