kaffo's recent activity
-
Comment on The Swedish-based “W” platform is the latest in a series of new social media sites vying to replace US Big Tech companies in ~tech
-
Comment on Tildes Survey #10: How often do you visit/read Tildes? in ~talk
kaffo LinkI think this is the first time I missed the survey actually getting posted haha. You must post it around the time I open tildes in the evening, because I always see it at the top of the home...I think this is the first time I missed the survey actually getting posted haha. You must post it around the time I open tildes in the evening, because I always see it at the top of the home screen, posted like 2 mins ago with no comments.
But yeah, at least once a day here. I try it be a good boy. -
Comment on Tildes Survey #9: How optimistic are you about the future? (Results) in ~talk
kaffo Link ParentI'm not surprised at all. I think many people here are tuned in well with the news and politics of the world, and it's extremely depressing. Most people are feeling their financial situations...I'm not surprised at all. I think many people here are tuned in well with the news and politics of the world, and it's extremely depressing. Most people are feeling their financial situations getting more and more difficult too as cost of living keeps rising and salaries don't match.
I had "somewhat optimistic" and "very optimistic" I think, but it's purely based on my own personal circumstances and my choice not to let the wider world effect my day to day happiness.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentI concerned a rant in the post but decided against it, I didn't want to put too much opinion in the top level. Maybe I should have put it in a collapsed section or just my own comment. Anyway yes,...I concerned a rant in the post but decided against it, I didn't want to put too much opinion in the top level. Maybe I should have put it in a collapsed section or just my own comment.
Anyway yes, thanks for asking. My opinion is that models and/or agents, given the right training and data, then have the capability to produce content which exceeds that boundary. But I would put it down to a combination of randomness and any software (the agent) to capture the high quality output and drop the low quality stuff.
Also I don't believe the step change would ever be large. We've proven that turning up the randomness on these models just produces more noise. I think there's a sweet spot where it'll start to produce content +/- 5 or 10% the threshold. You could capture that content above the line using some metric (would be difficult with the kind of boundary pushing content we are talking about) then feed that back into the next training set.So yeah, I think it's possible, but I don't think it's reliably pushing the boundary nor is it a large jump.
What I would like to see is models getting more specific and less general. Iterate training on a model that only does math, or law, or software engineer, etc. Give it focus, cut out the context it doesn't need and see if it can seriously push the boundary.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentNo, you have a point, it's not a good name. I mean "AI" isn't a good name for LLMs right now either, it's all marketing. Though, I'm afraid it might be one of those things we're stuck with for now...No, you have a point, it's not a good name. I mean "AI" isn't a good name for LLMs right now either, it's all marketing.
Though, I'm afraid it might be one of those things we're stuck with for now until the "next thing" comes along. But yeah, it will likely be the case that whatever is next is better at "generating" than generative AI.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentInteresting, one of the few people who thinks we will get to general AI "soon"! In your opinion how far away do you think current models are from "general AI" in terms of capability?Interesting, one of the few people who thinks we will get to general AI "soon"!
In your opinion how far away do you think current models are from "general AI" in terms of capability? -
Comment on Tildes Survey #9: How optimistic are you about the future? (Results) in ~talk
kaffo LinkThis is a fun question! As others have noted, the scale of what to be optimistic for is unclear. So it gets your thinking hat on! I'll be interested to see the results. For me, I'm very...This is a fun question!
As others have noted, the scale of what to be optimistic for is unclear. So it gets your thinking hat on! I'll be interested to see the results.
For me, I'm very optimistic. That's honestly because I'm just mostly happy these days, I've got a lot of good things going and don't read/watch the news. For those that read the advice thread I posted, I broke up with my ex partner too recently and while that's a little sad that's ending, I'm actually really excited about dating, socializing and the oppertunities I'll get from the breakup, at least for the next few months.
Also, I just got ADHD meds and I'm planning to post a thread about them at some point.In general, I think for people today it's so easy to get swept away with the big doom and gloom stuff. There's a lot of reasons why it's so popular to talk about in TYOOL 2026:
- Bad/scary news gets more attention than good news
- We have science and technology today to be able to determine issues that would have been invisible to us previously
- More of the world is in a position of not having to worrying about putting food on the table every day, or their other basic needs, so now their eyes pan up to the next most important thing
Global warming is scary, so is extinction levels and so many other things. But I'll be miserable if I worry about all those things, and I also can't do shit about any of them either because about 100 billionaires are doing most of the damage anyway. So I might as well be happy and then hope the next disaster we've predicted isn't that bad.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentThanks for the detailed reply, I agree it's very interesting and very in-depth. On your point of "what is intelligence". I, like probably many others, have been thinking about it and there's a...Thanks for the detailed reply, I agree it's very interesting and very in-depth.
On your point of "what is intelligence". I, like probably many others, have been thinking about it and there's a good reason we've not got agreement.
I suspect, in my opinion, if we knew the "source code" of how something like an individual sheep worked then we would look at it in a very different way. When Humans don't understand something, it's put on a pedestal (sometimes worshipped!) and I think we do that with consciousness and intelligence to some degree.
That's not to say it's not extremely impressive, especially as a biological evolution, but I think that because we fully understand how something works, we have a natural tendency to demote it.That said. I'm convinced that gen AI is not intelligent, but it is able to mimic intelligence. Which is confusing to a lot of users who don't understand what they are talking to.
How do we decide what is "intelligent" like you said? Who knows! I thought about it somewhat and I haven't come to a conclusion. But I think that at least a "thing" has to be able to make it's own decisions and those decisions must have some kind of reasoning behind them based on both external input and also their own internal memories and thoughts.
I don't think models (or agents) today meet this criteria. They mimic it well, especially well sometimes, but it's essential the same as a broken clock being right twice a day.I agree with much you've said in the rest of your comment, I can see us getting a long way in the right direction with gen AI. But it's not taking over the world quite yet.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentAh, I didn't know it had a proper term, but that's been on my mind. It's very valid. The context is a weird format for memory, especially for gen AI. Since it essentially drives the output and it...Ah, I didn't know it had a proper term, but that's been on my mind. It's very valid.
The context is a weird format for memory, especially for gen AI. Since it essentially drives the output and it also has perfect "recall" of everything in the context, the output would always be something "silicon based" and unnatural to us in my opinion.I suspect there's a format for memory that we haven't thought of yet. The current implementations of "memory" all suck, and they have no real signs of getting better. Especially since at the end of the day, all they do is modify the context.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentThat's interesting to know! Thanks for sharing, especially now Fable was locked down.That's interesting to know! Thanks for sharing, especially now Fable was locked down.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentThanks for the detailed reply. Very interesting take on the "world model" idea, that makes a lot of sense in terms of giving the model some context of the real world as opposed to just our...Thanks for the detailed reply.
Very interesting take on the "world model" idea, that makes a lot of sense in terms of giving the model some context of the real world as opposed to just our language.
I do agree with the take that gen AI won't lead to general AI but will help pave the way. Though I suspect there will be a lot of media coverage along the way (not that we don't get plenty of it already!) about how gen AI is actually already general AI and has thoughts and feelings.
-
Comment on Does generative AI have a natural limit without a major innovation? in ~comp
kaffo Link ParentSensible take. It does seem that gen AI is getting better at having more, and more broad models. Way back when the hype started in like 2023/2024 I wondered if we'd see extremely good, but...Sensible take.
It does seem that gen AI is getting better at having more, and more broad models. Way back when the hype started in like 2023/2024 I wondered if we'd see extremely good, but specialised models. Maybe they could talk to each other, or they could work together in some environment. But seems they've gone the general route and it's actually working out reasonably well.
Re self improvement, I'm sure it's being attempted. It's got to be in similar veins to reinforcement learning where they give the models a reward metric. But it must be slow as hell right now with how expensive training is.
-
Does generative AI have a natural limit without a major innovation?
I was musing about this recently with the recent models becoming more capable. The core of gen AI is the model, which is trained on a massive dataset. To date, gen AI has improved because the...
I was musing about this recently with the recent models becoming more capable. The core of gen AI is the model, which is trained on a massive dataset. To date, gen AI has improved because the models have become larger, more efficient, the data they are trained on has become better and the software/harnesses around them has improved to help query them.
As I see it, surely the bottleneck will soon become the data they are trained on? If we imagine a scenario where a models could consume an infinite amount of training data, and there is no limit to the training time or quality. The sum of human skill/knowledge is the limiting factor. Gen AI should (in theory) never be able to out preform or push the boundary of the sum of humanity at time of training.
Or, counterpoint, is there enough randomness and speed to iterate that gen AI can actually step change and improve if training times/cost were less prohibitive? Most companies/models today will save good output and feed it back into the next iteration, but right now that's taking months. What if that took minutes?
What do you think?
Is gen AI going to take us to general intelligence?
Will gen AI get to a place where it's "intelligence" and reasoning is actually better than the sum of Humanity?27 votes -
Comment on My partner says our relationship has always felt suffocating, but she does not know what she wants. What would you do? in ~life
kaffo Link12.06.26 Update Hey everyone, I wanted to post an update after a very complicated week. First off, my (ex) partner and I have agreed to break up. I did feel a weight off my shoulders and the...12.06.26 Update
Hey everyone, I wanted to post an update after a very complicated week.
First off, my (ex) partner and I have agreed to break up. I did feel a weight off my shoulders and the longer I sat with it the more I realised I was pushing her over and over again into a relationship she didn't want, but I did. It was never going to work as we want different things right now.
That said, some good out of it all. She is really keen on getting into therapy and trying to work through her issues so she can get to a place (eventually) to really embrace a romantic relationship. She's still finding this all really hard to process, but I think that she really has some deep feelings for me she's unable to express (or really understand herself) that she desires, but she's self aware enough to know she's not ready for that yet.
For me, I'm moving out. I found a decent apartment, I signed a lease and I'm leaving next week. It's a move an hour and a half away, I've got a lot on my plate for the move but looking for a therapist near my new place is high on the list once I get there.
I've come to realise over the last week with some introspection that I do have some bad, obsessive qualities around my romantic relationships. I always have and I suspect it's been a problem for other ex's too. I have a tendency to see a negative mood or reaction then respond with a "good boyfriend" act, like a romantic gesture or more quality time. Instead of asking my partner what they want or need, I just assume and I get upset when they don't respond well.
I said it before, I'm always working on myself. I think I am a better person in a lot of ways now than I have been in the past, and this is another step in the right direction. Of course, I'd like to speak to a professional about it and dig deeper. It's been a bit of an eye opening experience for me.
Anyway. I move out soon, I've already got a lot of fun activities planned for myself which I'm excited to go to in the next few weeks. My (now) ex asked if we could stay friends and I said we could try, but be prepared to go no contact if there's feelings involved.
Thank you everyone for your support, comments and most importantly the people who called me out. This community is wonderful and I'm very glad to be here.
-
Comment on Are there any games that had their development abandoned that you followed where you wish that continued/completed development? in ~games
kaffo Link ParentAre you talking about the game DayZ or the mod DayZ? I'm also somewhat critical of Dean's decisions and ways of working, but I listened to him in a few interviews where he talked about his past...Are you talking about the game DayZ or the mod DayZ?
I'm also somewhat critical of Dean's decisions and ways of working, but I listened to him in a few interviews where he talked about his past and his philosophy.
His days at Bohemian making DayZ the game sounded like torture, he had a horrible time and he ended up leaving after a lot of burn out.Through all that though, he does sound like a guy who just likes video games and wants to make cool stuff that big studios aren't willing to do. His employees seem to like working at his studio, their games have slowly got better over time in a lot of ways and he has some good ideas in my opinion.
But he has made a lot of mistakes and he's on the verge of quiting from what he said in a recent interview. I don't personally put him on a pedestal, he's so far probably put in more neutral or negative input to the community than good, but it sounds like he wants something better and he's trying.
So I dunno, I'd say give him some slack. He just seems like a pretty normal dude who got a shit load of money from a dumb idea he had to me to be honest. A lot of people would say and do dumb shit after that.
-
Comment on Any fellow software engineers using paid GitHub copilot? in ~comp
kaffo Link ParentSame here. It's more money to the bubble isn't it? I mean, at some point either we are going to start to see more heavy usage restrictions or models will become more efficient and it won't matter....Same here. It's more money to the bubble isn't it?
I mean, at some point either we are going to start to see more heavy usage restrictions or models will become more efficient and it won't matter.
I suspect it'll happen around the same time. Already Opus is capable of handling a lot of day to day tasks. I've been reading that Fable is a step up and sounds like it's actually overkill for most dev work.
If an Opus tier model was much cheaper to run, then most people would probably be fine?
I'm sure they'd continue to push the boundary and see how good at reasoning they can get it, but those models could become prohibitively expensive if it's pushing past "human reasoning" and they could probably get away with it I imagine. -
Comment on Are there any games that had their development abandoned that you followed where you wish that continued/completed development? in ~games
kaffo Link ParentThe same studio, different team. There is a third team that provides the "engine" that both Stationeers and KSA use. It's quite interesting, they call it BRUTAL and it's essentially an API wrapper...The same studio, different team. There is a third team that provides the "engine" that both Stationeers and KSA use.
It's quite interesting, they call it BRUTAL and it's essentially an API wrapper around Vulken, rather than a game engine. -
Comment on What's a game you're dying to play that doesn't exist? in ~games
kaffo LinkI have some stupid ideas for multi-player games that have weird play styles that I don't think anyone would actually play haha. An MMO style game about trading, logistics, crafting and production....I have some stupid ideas for multi-player games that have weird play styles that I don't think anyone would actually play haha.
- An MMO style game about trading, logistics, crafting and production. There'd be some gigantic map with biomes. The players would be expected to group up in guilds (or I dunno, maybe you could freelance too) to extract resources from around the map, move them to some factory/crafting area then package and sell the goods somewhere else. My thought was every step would always be to big for any one guild or group, so they'd have to work together and make agreements/deals with each other. I'd also encourage areas of pvp. They'd be explicitly marked on the map and would only gate keep the specific resources, routes or locations. Now the gimmick. I would force a reset every so often, but it wouldn't be instant. I think the resources in one area would slowly run out, but at the same time they would start to spawn in another. This would encourage constant scouting/prospecting for high value resources which could show up anywhere. And likewise a favourable or unfavourable set of respawns could completely change the game. I was thinking the trade would be powered by NPC cities which buy bulk goods at various prices across the world. But obviously their needs and prices change over time too.
- I had an obsession with building an extremely tight vehicle combat game. The original idea had a sci fi war theme but you could kinda do anything to be honest. The idea was various vehicles would require various numbers of players to man. The 1 player vehicles being fast scouts and the more players the more coordination and possible strength. I guess the actual "game" was gonna be a bit like Planetside where there's like a constant war over an area and both sides are pushing back and forth. But it could also be more like a death match like world of tanks/warthunder.
- A pvp or pve, turn based farming game. This sounds so boring, but I wanted to make a really involved game about farming, where it simulates crop growth, pest, diseases, soil, yada yada. Plus all the other stuff like animals, some productions, workers, machinery... If it was balanced right I'd hope there would be no one meta strategy, but instead a few ways to play that would be valid.
- An idle-ish multi-player trading/raiding mobile game. It had both a space/sci fi and a medieval theme at different points. But the idea is you could jump into any server/instance and start with either a trading or a raiding setup. As a trader you'd get some capacity to move goods then off you go, trying to setup trades by sending your ship (I'll stick to the sci fi theme) to a place and giving it an order to buy, then waiting in real time. Raiders can try and detect ships nearby and if they pick something up then get a notification to try and intercept it. If they try the trader gets a notification to try and do something in return. There's this kinda back and forth, nothing happens quickly. A trade route might take a day and a raid might take a few hours, but the time investment on the app isn't very long when you check in. There could also be stuff like being a caravan guard, a player economy, having an actual bounty game loop too rather than just raiding.
These are all stupid ideas I had over the years and never actually bothered to finish lol
-
Comment on Are there any games that had their development abandoned that you followed where you wish that continued/completed development? in ~games
kaffo Link ParentI know what you mean. I just wanted to check are, are you aware of Kitten Space Agency? It's Dean Hall's (DayZ) game studio and he got together an incredible team of people. Many of which worked...I know what you mean. I just wanted to check are, are you aware of Kitten Space Agency?
It's Dean Hall's (DayZ) game studio and he got together an incredible team of people. Many of which worked on KSP, KSP2 and/or popular mods. Fillipe is on the project too as an advisor.
Anyway, it looks really hopeful that it will eventually live up to KSP2. Though I would warn to read about Dean's... Interesting business model. He has some beef with Valve and Steam as a platform. Personally I think some of his beef is valid but some is clearly personal. And he's trying something new to make the game as easy to play and DRM free as possible. Which is a really cool idea, but there's been a lot of criticism around it.
-
Comment on Tildes Survey #8: What is your favorite video game? (Results) in ~talk
kaffo LinkI loved all the other questions, but this one I find so awkward. What does "favorite" mean? How can you choose one? How will the data be useful? I know it's for fun, but we had so many other good...I loved all the other questions, but this one I find so awkward. What does "favorite" mean? How can you choose one? How will the data be useful?
I know it's for fun, but we had so many other good questions on the list! Maybe we'll get around to them lol.I put down Return of the Obra Dinn. It always comes to mind when I think of "favorite game" because it's such a neat package. It's not too long, it's unique, it tells a wonderful story, it's got really cool mechanics and it's awesome to talk about.
I spent hours after playing discussing with other people who played it how they solved certain parts of the game and it's completely mind blowing how everyone solves it. Some struggle where others breeze past it. It's a complete must play for anyone who enjoys any kind of problem solving and/or puzzles.
I would legit actually try it out too. If it was like no frills Facebook/MySpace/bebo where it was actually a place where you posted stuff for your friends to see and you saw stuff your friends posted. Then I would be so on board.
But no, we gotta have everyone's feed full of the Jenners, Elon Musk and adverts, not your actual friends.