I was musing about this recently with the recent models becoming more capable. The core of gen AI is the model, which is trained on a massive dataset. To date, gen AI has improved because the models have become larger, more efficient, the data they are trained on has become better and the software/harnesses around them has improved to help query them.

As I see it, surely the bottleneck will soon become the data they are trained on? If we imagine a scenario where a models could consume an infinite amount of training data, and there is no limit to the training time or quality. The sum of human skill/knowledge is the limiting factor. Gen AI should (in theory) never be able to out preform or push the boundary of the sum of humanity at time of training.

Or, counterpoint, is there enough randomness and speed to iterate that gen AI can actually step change and improve if training times/cost were less prohibitive? Most companies/models today will save good output and feed it back into the next iteration, but right now that's taking months. What if that took minutes?

What do you think?

Is gen AI going to take us to general intelligence?
Will gen AI get to a place where it's "intelligence" and reasoning is actually better than the sum of Humanity?

Hi, so I've been thinking about this for several days now, and thought it might be an interesting topic for Tildes.

Earlier this week, YouTube suggested this AI Sitcom video to me. Some of the jokes are actually very cohesive "Dad jokes", and it got me wondering how much of the video was AI generated. Are the one-liners themselves AI generated? Was this script generated with AI, and then edited before passing it on to something else to generate the video and voice? Or are we at the phase where AI could generate the whole thing with a single prompt? If it's the latter I find this sort of terrifying, because the finished product is very cohesive for something with almost no editing.

I'd also be interested in discussing where this video might have come from. The channel and descriptions have almost no information, so it seems like this may be a channel that finds these elsewhere and reposts? Or maybe the channel is the original and just trying to be vague about technology used?

Also side note, I have no idea if this belongs in ~Tech, so feel free to move it around as needed.