Paper Dude made an "LLM" (just a perceptron, which is the simplest kind of neural net) using goats in the AoEII scenario creator to try to demonstrate the absurdity of calling LLMs sentient. I...
Dude made an "LLM" (just a perceptron, which is the simplest kind of neural net) using goats in the AoEII scenario creator to try to demonstrate the absurdity of calling LLMs sentient.
I think the logic doesn't fully work, probably because he's going out of his knowledge zone, but it could be much worse with this premise.
He doesn't believe it's fully absurd, but rather that the things people say are absurd in their specific formulations:
He’s also not ruling out that LLMs have some form of consciousness, but said that’s beside the point. “We tend to ascribe consciousness as some sort of binary construct (either it is or isn't!) but I'd argue that there are levels. It's hard to say that humans aren't conscious. But, what about a dog? Yes, of course. What about a potato? What about a virus? It's quite relative and we do tend to go for something human-like when we evaluate/define it, where, in reality, LLMs are things we have never seen before,” he said. “There was a recent article in science about bumblebees solving problems. Everyone was like surprisedpikachu.png — it's a great, amazing discovery. I love bumblebees and people understanding their behaviour is absolutely fantastic. But, did we really assume that they couldn't perform some sort of problem-solving? Why are we so surprised?”
The paper reads strangely to me. He painstakingly and explicitly reminds us that he’s not taking a stand on the consciousness question, but then implicitly makes it pretty clear that the AoE II...
The paper reads strangely to me. He painstakingly and explicitly reminds us that he’s not taking a stand on the consciousness question, but then implicitly makes it pretty clear that the AoE II implementation is intended as a gotcha to the people anthropomorphising LLMs in even the loosest ways.
Like… isn’t it pretty standard to assume consciousness/sentience/sapience is a function of complexity? Off the top of my head, with no rigour whatsoever, without even defining specifically what quality of mind I’m measuring (because even I don’t know), I’d still expect something like this to be a pretty uncontroversial take:
Bacteria: very unlikely
Flies: probably not
Dogs: hmmm… maybe a bit
Dolphins: yeah, getting there
Chimps: quite possibly
Humans: yes
If you managed to get >50B parameters into the AoE II implementation, I imagine the goats would start showing patterns that hit the dolphin-or-greater level on that chart and creating outputs that would get people debating the same way they do about LLMs now.
I think I get his very broad point: that the use of language pushes people to anthropomorphise more and sooner than they otherwise would. I actually agree with that point. But then he seems to see the AoE II example as a valid reductio ad absurdum when it’s actually a totally different thing (because complexity is an inherent and important part of the question), and when it probably wouldn’t be perceived as absurd at all if it were made sufficiently complex.
[Edit] Side note: not only are the replies below fascinating, they’re doing a wonderful job of underlining how happy we are to ascribe the qualities the paper talks about to biological beings without language! I think the author really did over-index on how much language is a necessity for humans to start anthropomorphising things.
Glad I'm not the only one. I feel fairly confident that flies have some sort of base level consciousness/awareness/sentience. I suppose it depends how exactly you want to define consciousness....
Glad I'm not the only one. I feel fairly confident that flies have some sort of base level consciousness/awareness/sentience. I suppose it depends how exactly you want to define consciousness. Bacteria I'm less clear on but I wouldn't feel comfortable completely ruling it out. Whereas I feel pretty comfortable saying that I don't think LLMs qualify on that scale. It seems to me that most of the research in the last 60+ years repeatedly finds that there are more and more of the things that we associate with human consciousness to be found at smaller and smaller scales in non human biological life.
I think the issue is that "sentience/sapience" is two completely different things. For sentience, yeah that's controversial. For sapience, though, I would say it's pretty uncontroversial to say...
I think the issue is that "sentience/sapience" is two completely different things. For sentience, yeah that's controversial. For sapience, though, I would say it's pretty uncontroversial to say that dogs can be smart but they aren't intelligent in the sense of "intelligent life."
I thought you were going to say flies!! I think it is rather controversial to contend that dogs are not sapient. I don't.. I don't know what qualification you could have for sapience that doesn't...
I thought you were going to say flies!! I think it is rather controversial to contend that dogs are not sapient. I don't.. I don't know what qualification you could have for sapience that doesn't include dogs, actually, unless your requirement is a very specific human-oriented definition of language. Dogs absolutely have a sense of self, form complex social relationships, learn from their experiences (rapidly!), develop intuitions and biases, and experience emotions.
It seems that there are a pretty wide number of definitions of sapience! I just pulled up the sapience framework from UW professor George Mobus, which says that the four components of sapience...
It seems that there are a pretty wide number of definitions of sapience! I just pulled up the sapience framework from UW professor George Mobus, which says that the four components of sapience are: judgment, strategic perspective, systems perspective, and moral sentiment. I think it's... probably challenging? to evaluate exactly to what extent another species (especially one that we can't communicate with via language) expresses those components, but I also think we probably don't know enough about cognition to categorically state that dogs do not express them in a way that is sufficient to define as sapience? Admittedly I am not a consciousness researcher, so I'm probably wrong. But even your definition leaves a lot up to interpretation, I think. How deeply? There are plenty of things that many Border Collies seem to understand fairly deeply, including their relationships to other dogs and people.
Also I should say that I genuinely might have just misunderstood the definition of sapience. It does seem like it was basically coined to describe human-level intelligence, such that it almost definitionally could not refer to any animals that are less (or, even maybe differently?) intelligent than humans. I was under the impression that that wasn't how it was still used in modern consciousness research, but it seems not unlikely that I was wrong on that front!
I'm sure there are outliers who would say otherwise. I also know it's not as cut and dry as we'd like it to be — sapience seems to be a gradient, not a binary. But generally speaking, the...
I'm sure there are outliers who would say otherwise. I also know it's not as cut and dry as we'd like it to be — sapience seems to be a gradient, not a binary. But generally speaking, the consensus among most professionals is that homo sapiens are the only sapient species.
Here are a few quotes from the link you gave to support that:
From page one (you linked page three), it's a human thing.
Sapience is the brain basis for what is unique in human cognition. It is significantly evolved in the current human species and demonstrably produces very important executive functions in this species. It is the basis for the development of whatever capacity for wisdom we see in humans. Wisdom develops over the life of an individual as a result of sapience functions obtaining tacit knowledge and using that knowledge to form moral, strategic, and systemic judgments.
Sapience is an inherent, that is genetically mediated, capacity of brains that have greater processing power in key regions of the prefrontal cortex (Part 4). However, it is not sufficiently well developed in the vast majority of the population, which could explain why humanity is in the mess it is in today. We've made some very unwise choices throughout history. We continue to fail to learn from our past mistakes, both individually and collectively. Our lack of wisdom on both fronts will doom us to make more serious errors in the future. It could possibly lead to the extinction of the genus Homo as there are no other representatives of the only talking ape, sapiens.
Sapience makes humans unique among other animals.
Thus, sapience and consciousness are interrelated as operations at the highest level of the hierarchical cybernetic architecture of the mind. This, I think, is at least part of the explanation of what is unique about human beings as animals. Our minds have evolved this sapience/consciousness apparatus to achieve strategic control not only for a single individual, but for a social body as well. In a sense this mechanism implements a kind of distributed strategic control function among members of a tribe/family.
Here he implies higher mammals possess a second-order consciousness, but not sapience.
One more note on the issue of consciousness before going back to a more mechanical explanation of sapience. Most people will accept that animals are, in some sense, aware of their environments. Many will also accept that some higher mammals, e.g. chimpanzees and possibly dolphins, are self aware. That is they have what I have called second-order consciousness. Self awareness includes awareness of the self being aware of the environment. Such second-order consciousness may have been the route to higher sociality (than just a herd or colony) in mammals. Chimpanzees recognize one another as individuals. They have unique personalities (some claim the same for dolphins and elephants). But sapience may add yet a higher order to consciousness, at least what I have called a 2½-order consciousness wherein we are occasionally aware of being aware of awareness!
Strategic Perspective, one of the authors four main functions of sapience, is unique to the genus Homo.
Sapience is built upon formerly evolved functions such as simple judgment, systems perspective and moral sentiments, primitive versions of which are seen in many mammals and some birds. Strategic perspective and thinking, at least in terms of thinking beyond the immediate future, seems to be a unique function in the genus Homo; I will return to the evolutionary perspective in the final installment.
Sapience is essentially just wisdom, specifically human-level wisdom. And since sapience is wisdom, some homo sapiens may be more sapient than others. Again, an interesting quote from your link:
The question of competency level is an important one. In the case of intelligence the definition of the norm is a statistical property of the population. We assign the value of 100 as the intelligence quotient of the average person (the peak of a bell curve). And for the issues in life that intelligence, or cleverness, is good for addressing, this system seems to work pretty well to attribute relative intelligence levels. Since the curve is Gaussian the bulk of people are near the norm and there are jobs for everyone. But with sapience the situation may be different. If it is a newly emerged capability in Homo, as I suspect, then the distribution curve may have a more skewed shape. It may be that the majority of people fall in the lower end of the curve. In the last installment I will explore this possibility more fully. Consider, for now, that such a distribution might well explain the seeming paucity of wisdom in our current societies. That we as a species are in the mess we are in because our cleverness exceeds our wisdom would be a reasonable conjecture.
With all that said, that article is essentially exploring the question if humans are so smart, then why are we so fucking stupid? It's not exploring which other species may be sapient. However, throughout all five sections, it's heavily implied that the author is working from the basis that homo sapiens are the only sapient species, that is just a given, and there's no real interest in exploring otherwise.
Fair, this stuff is never straightforward! I guess that’s gonna depend on how we’re defining whatever quality we’re measuring, which I was deliberately fuzzy on because I don’t have the best...
Fair, this stuff is never straightforward! I guess that’s gonna depend on how we’re defining whatever quality we’re measuring, which I was deliberately fuzzy on because I don’t have the best handle on what consciousness is (do any of us, really?), let alone sentience or sapience.
It does sound like you’re on a similar page about complexity being important, though? Even if you’re putting the boundary lower than I did - maybe from a philosophical or biological difference of opinion, maybe from a semantic one on what we’re defining - the idea that there is a gradient of some kind and a reasonable cutoff point still seems to be shared.
Honestly the only thing that’s really surprised me in this thread is from @AnEarlyMartyr - the idea of putting bacteria as a stronger maybe is a slight surprise to me, not a wild one, but doing so and confidently ruling out LLMs genuinely doesn’t fit within my worldview! For the record, I’m absolutely not of the opinion that current LLMs are conscious, although I see no reason to rule out machine consciousness as a possibility in general (even if perhaps only in the far far future). I just struggle to ascribe a “maybe there’s emergent behaviour there that we don’t understand” to a biological machine like a bacterium or a fly without being forced to ascribe the same thing to a trillion parameter ball of statistical input/output processing.
Personally, I'm a bit of a biological chauvinist; i.e., my prior is that organic brains are more likely to be conscious than non-organic "brain-like things" of similar or even greater complexity....
I just struggle to ascribe a “maybe there’s emergent behaviour there that we don’t understand” to a biological machine like a bacterium or a fly without being forced to ascribe the same thing to a trillion parameter ball of statistical input/output processing.
Personally, I'm a bit of a biological chauvinist; i.e., my prior is that organic brains are more likely to be conscious than non-organic "brain-like things" of similar or even greater complexity. Actually, I have some doubt that digital brains can ever be conscious on any scale of complexity.
I'd personally say insects and below are just biological automata. But mice/fish are where I begin to entertain some shade of gray on the consciousness scale.
I'd personally say insects and below are just biological automata. But mice/fish are where I begin to entertain some shade of gray on the consciousness scale.
I question insects on some level. I know that butterflies were proven to retain memories as caterpillars by a 10-year-old Japanese boy, who first got curious because he noticed that butterflies...
I question insects on some level. I know that butterflies were proven to retain memories as caterpillars by a 10-year-old Japanese boy, who first got curious because he noticed that butterflies he'd raised from caterpillars would fly back to him when he tried to release them. Which is super sweet and adorable, and highlights to me that the caterpillars/butterflies at least recognized him and considered him "safe".
On a personal level, I remember one stinkbug at our old house spent probably half an hour just crawling up and down a charging cable slung over the end table. It'd reach one end, turn around, crawl the other way, then turn around and repeat. It could've easily hopped off at any point after reaching a dead end, or onto the table while the cable crossed over it, but it seemed totally content to just crawl endlessly until I caught it to take outside. We had a lot of stinkbugs get in that house, but none of them behaved like that. The only explanations I can come up with are some variation of it either found that fun, or it was particularly stupid, both of which imply some level of thought/intelligence.
Of course, we may very well just be reading too much into it. Humans have an instinct to humanize everything. But who knows? Our understanding of sentience is automatically biased towards... Well, brains. Insects may have some different form of "sentience" and/or consciousness that we haven't considered.
I dunno. I have a shrimp tank and even these bottom feeders have some personality to them. Maybe some of that is just that human tendancy to humanise everything. My pet rock has some personality...
I dunno. I have a shrimp tank and even these bottom feeders have some personality to them.
Maybe some of that is just that human tendancy to humanise everything. My pet rock has some personality if you stare at it long enough.
People humanize their cats in Minecraft. I don’t think being able to see some kind of humanity in a living thing means it must have anything like a human experience.
People humanize their cats in Minecraft. I don’t think being able to see some kind of humanity in a living thing means it must have anything like a human experience.
I agree. Consciousness scales with complexity. I'm not sure exactly what that line looks like either. Even just looking at a human. I think we can agree that a single brain cell kept alive in a...
I agree. Consciousness scales with complexity. I'm not sure exactly what that line looks like either. Even just looking at a human. I think we can agree that a single brain cell kept alive in a petri dish would be unlikely to be conscious. So there must be a threshold. Humans are complex with hormone squirting glands and electric signal flinging brain cells. How much, and what parts are needed to support consciousness?
Consciousness as a function of complexity is interesting. I consider myself maximally "conscious" but I have nothing to back that up. Theoretically something sufficiently complex could become more...
Consciousness as a function of complexity is interesting. I consider myself maximally "conscious" but I have nothing to back that up. Theoretically something sufficiently complex could become more conscious than human? Is there a cap to this or does the level consciousness continue to scale with complexity to infinity?
Even humans are not really maximally conscious. A lot of our thought processes are done unconsciously, like language generation and most decision making. We are only aware of a portion of our...
Even humans are not really maximally conscious. A lot of our thought processes are done unconsciously, like language generation and most decision making. We are only aware of a portion of our internal processing, and even that awareness is pretty inconsistent (e.g., blanking out while driving your regular commute).
If I understand correctly that's an evolutionary adaptation that's beneficial to us. So a being that is more complex than us I wouldn't think would necessarily have less of the unconscious hidden...
If I understand correctly that's an evolutionary adaptation that's beneficial to us. So a being that is more complex than us I wouldn't think would necessarily have less of the unconscious hidden away from them, maybe they'd have even more to allow more focus on other, more important things.
To your point though, I guess It doesn't make sense to call myself "maximally conscious" without access to those parts of me. I'll have to rethink that.
See this is also really interesting! It’s kinda tough properly discussing something that we don’t entirely know how to define, but I was envisaging it more as a cutoff point of some kind (a...
See this is also really interesting! It’s kinda tough properly discussing something that we don’t entirely know how to define, but I was envisaging it more as a cutoff point of some kind (a necessarily fuzzy one, as all things are when they hit reality, but a cutoff nonetheless) where we err on the side of caution in the grey area but largely define above the line as above the line in a binary sense.
But then I suppose I am inherently considering a gradient on some axis too (possibly a different axis?) because I have different concerns about what I’d consider ethical treatment of creatures at different points on the list. It’s a fascinating topic, that’s for sure!
I don't think we actually know that complexity is the right metric. I mean, I think it's undeniable that with greater complexity you can make something that seems more conscious; but just because...
I don't think we actually know that complexity is the right metric. I mean, I think it's undeniable that with greater complexity you can make something that seems more conscious; but just because something seems more conscious, or can convince more people, doesn't necessarily mean that it is conscious.
There was a paper a couple months back that presented possible evidence of quantum effects in the brain. If that's true (and I have no idea) then it could be that consciousness doesn't actually require all that much complexity, but it does require these weird quantum effects.
That being said, maybe it doesn't really matter? If something is complex enough that it can do useful stuff, then whether it is conscious is really more of a philosophical / ethical question.
Was that Roger Penrose, by any chance? I was fortunate enough to be at one of his talks a few years back, and he dipped into theory of consciousness among a lot of other fascinating topics. I can...
Was that Roger Penrose, by any chance? I was fortunate enough to be at one of his talks a few years back, and he dipped into theory of consciousness among a lot of other fascinating topics. I can certainly believe the conceptual idea that as-yet-unexplored quantum effects, and/or higher-order interactions in the structure of the electrical fields of the neurons far beyond the signal:response “circuitry” we can currently analyse could be crucial.
We’re definitely in deep “nobody really knows yet” territory, which I always find exciting! I’ll admit I find it hard to conceptualise a “brain” that could trigger these kind of interactions we don’t even yet understand without being fairly complex - even if complex in ways we can’t yet measure - but as you say, we don’t know anything for sure right now.
I tried to figure out where I read about it, but no luck. Some searching revealed that there have been a bunch of papers published in the last few years with similar findings or conjectures, so...
I tried to figure out where I read about it, but no luck. Some searching revealed that there have been a bunch of papers published in the last few years with similar findings or conjectures, so maybe it's not so far-fetched.
It matters…, it matters a whole lot in my opinion! I see where you’re coming from with it, but I don’t think this idea generalizes to a (potential) future time full of technological advances,...
That being said, maybe it doesn't really matter? If something is complex enough that it can do useful stuff, then whether it is conscious is really more of a philosophical / ethical question.
It matters…, it matters a whole lot in my opinion!
I see where you’re coming from with it, but I don’t think this idea generalizes to a (potential) future time full of technological advances, under the assumption that we want – at minimum – human beings to be governed under some general principles of nicety, such as the UN's universal human rights declaration.
This was probably a bit abstract. For one example of what I’m talking about: MMAcevedo is a sci-fi-horror “Wikipedia“-style entry, but regardless of that, I’ve turned into a stark opponent of most anything related to brain-scanning and -uploading (whereas before reading it I would’ve considered myself to be neutral towards, maybe even curious about such a future technology). Being sapient or sentient suddenly matters a lot more if you could be made to experience orders of magnitude more things (hours, tasks, emotion, pain signals) than any biological organism was ever meant to live through. That’s dangerous territory!
Now consider this thought experiment: What happens if one day, we actually succeeded in producing working/runnable brain scans, and it hypothetically were to turn out that their internal structure can be transformed to be basically an identical match to how LLMs’ matrices work and look like – would we still feel comfortable sending these machines out to do “useful stuff“ for us, with no limitation on the content or duration of work done?
Could we still treat machines that, while built in a wholly different way, internally function just like a “human [scan]“ as non-sentient? Or, reverse that and conclude that not even humans deserve the rights we fundamentally admitted to sentient/sapient beings?
There is a competing view that maybe everything actually is conscious, but if you dont think about it then it doesnt really matter in a meaningful way. Like, maybe rocks are actually conscious but...
There is a competing view that maybe everything actually is conscious, but if you dont think about it then it doesnt really matter in a meaningful way.
Like, maybe rocks are actually conscious but since they dont have the capacity to think they cant really suffer or fall in love or anything so nobody cares, its just an eternity of being aware of heat or pressure or whatnot.
And then as you go into various forms of life you develop sophisticated systems for sensing and responding to the environment, and that consciousness starts mattering more because it somehow couples into those complex systems and affects how living things behave.
And then eventually at the tier of life humans are at, you develop self awareness and that amplifies the significance of consciousness in some sense, which is why we think of there being a cutoff between chimps and ants.
I’m not sure how implementing a perception in AoE is supposed to indicate anything. Do they not know what a Turing machine is? You can often contrive ways for programs running on a Turing machine...
I’m not sure how implementing a perception in AoE is supposed to indicate anything.
Do they not know what a Turing machine is? You can often contrive ways for programs running on a Turing machine to themselves be Turing complete. Many video games apply. So do unexpected things like CSS or the c++ preprocessor.
Unless you believe it is completely impossible for a Turing machine to represent consciousness, then it will be possible theoretically to construct said machine consciousness in Minecraft or whatever, because Minecraft is Turing complete. It do be like that.
I've been increasingly annoyed with coverage from 404 Media on the topic of AI. It just seems to me that they're pessimistic and gleefully contrarian on the subject despite the clear advances in...
I've been increasingly annoyed with coverage from 404 Media on the topic of AI. It just seems to me that they're pessimistic and gleefully contrarian on the subject despite the clear advances in the field. I've not seen them lose one kind word about modern attention-aware transformers.
Of course, they're not obliged to, anyone can write what they want, but it does to me paint a pattern. They're just all too ready to jump on any story that even slightly antagonises "AI", as if that means anything.
This article in specific requires a broken premise. I don't think any researcher worth their weight in salt is saying that any LLM currently in development or on the market is, has ever been, or can be conscious.
I don't think I need to expand on this, but if anyone's curious, here's a collection of articles that I thought were particularly uncharitable and really only read to me as gawking at the (admittedly numerous and very funny) failures symptomatic of an industry in a state of panicked flailing.
I had discovered 404 via artists on Fedi, so if they exist at that intersection of art and technology the hostilities toward genAI in particular make sense. But I also don't understand how you...
I had discovered 404 via artists on Fedi, so if they exist at that intersection of art and technology the hostilities toward genAI in particular make sense.
But I also don't understand how you consider that Trump one in particular uncharitable at all. Best I can tell it's not even criticizing the tech so much as the ignoramus in chief and companies kowtowing to his bigotry.
There is also something to be said that they do substantial investigative journalism. And generally speaking, that means reporting on the dirty underbelly than the squeaky clean PR releases.
Schrodinger originally came up with that metaphor to clown on the Copenhagen interpretation, but now its just what everyone goes to as their default explanation of quantum mechanics.
Schrodinger originally came up with that metaphor to clown on the Copenhagen interpretation, but now its just what everyone goes to as their default explanation of quantum mechanics.
Paper
Dude made an "LLM" (just a perceptron, which is the simplest kind of neural net) using goats in the AoEII scenario creator to try to demonstrate the absurdity of calling LLMs sentient.
I think the logic doesn't fully work, probably because he's going out of his knowledge zone, but it could be much worse with this premise.
He doesn't believe it's fully absurd, but rather that the things people say are absurd in their specific formulations:
The paper reads strangely to me. He painstakingly and explicitly reminds us that he’s not taking a stand on the consciousness question, but then implicitly makes it pretty clear that the AoE II implementation is intended as a gotcha to the people anthropomorphising LLMs in even the loosest ways.
Like… isn’t it pretty standard to assume consciousness/sentience/sapience is a function of complexity? Off the top of my head, with no rigour whatsoever, without even defining specifically what quality of mind I’m measuring (because even I don’t know), I’d still expect something like this to be a pretty uncontroversial take:
If you managed to get >50B parameters into the AoE II implementation, I imagine the goats would start showing patterns that hit the dolphin-or-greater level on that chart and creating outputs that would get people debating the same way they do about LLMs now.
I think I get his very broad point: that the use of language pushes people to anthropomorphise more and sooner than they otherwise would. I actually agree with that point. But then he seems to see the AoE II example as a valid reductio ad absurdum when it’s actually a totally different thing (because complexity is an inherent and important part of the question), and when it probably wouldn’t be perceived as absurd at all if it were made sufficiently complex.
[Edit] Side note: not only are the replies below fascinating, they’re doing a wonderful job of underlining how happy we are to ascribe the qualities the paper talks about to biological beings without language! I think the author really did over-index on how much language is a necessity for humans to start anthropomorphising things.
I think that's pretty controversial! For flies I would say "probably", and for everything above I would say "certainly".
Glad I'm not the only one. I feel fairly confident that flies have some sort of base level consciousness/awareness/sentience. I suppose it depends how exactly you want to define consciousness. Bacteria I'm less clear on but I wouldn't feel comfortable completely ruling it out. Whereas I feel pretty comfortable saying that I don't think LLMs qualify on that scale. It seems to me that most of the research in the last 60+ years repeatedly finds that there are more and more of the things that we associate with human consciousness to be found at smaller and smaller scales in non human biological life.
I think the issue is that "sentience/sapience" is two completely different things. For sentience, yeah that's controversial. For sapience, though, I would say it's pretty uncontroversial to say that dogs can be smart but they aren't intelligent in the sense of "intelligent life."
I thought you were going to say flies!! I think it is rather controversial to contend that dogs are not sapient. I don't.. I don't know what qualification you could have for sapience that doesn't include dogs, actually, unless your requirement is a very specific human-oriented definition of language. Dogs absolutely have a sense of self, form complex social relationships, learn from their experiences (rapidly!), develop intuitions and biases, and experience emotions.
Sapience refers to the ability to deeply understand things and make sound decisions based on that understanding. Dogs categorically do not have this.
It seems that there are a pretty wide number of definitions of sapience! I just pulled up the sapience framework from UW professor George Mobus, which says that the four components of sapience are: judgment, strategic perspective, systems perspective, and moral sentiment. I think it's... probably challenging? to evaluate exactly to what extent another species (especially one that we can't communicate with via language) expresses those components, but I also think we probably don't know enough about cognition to categorically state that dogs do not express them in a way that is sufficient to define as sapience? Admittedly I am not a consciousness researcher, so I'm probably wrong. But even your definition leaves a lot up to interpretation, I think. How deeply? There are plenty of things that many Border Collies seem to understand fairly deeply, including their relationships to other dogs and people.
Also I should say that I genuinely might have just misunderstood the definition of sapience. It does seem like it was basically coined to describe human-level intelligence, such that it almost definitionally could not refer to any animals that are less (or, even maybe differently?) intelligent than humans. I was under the impression that that wasn't how it was still used in modern consciousness research, but it seems not unlikely that I was wrong on that front!
I'm sure there are outliers who would say otherwise. I also know it's not as cut and dry as we'd like it to be — sapience seems to be a gradient, not a binary. But generally speaking, the consensus among most professionals is that homo sapiens are the only sapient species.
Here are a few quotes from the link you gave to support that:
From page one (you linked page three), it's a human thing.
Sapience makes humans unique among other animals.
Here he implies higher mammals possess a second-order consciousness, but not sapience.
Strategic Perspective, one of the authors four main functions of sapience, is unique to the genus Homo.
Sapience is essentially just wisdom, specifically human-level wisdom. And since sapience is wisdom, some homo sapiens may be more sapient than others. Again, an interesting quote from your link:
With all that said, that article is essentially exploring the question if humans are so smart, then why are we so fucking stupid? It's not exploring which other species may be sapient. However, throughout all five sections, it's heavily implied that the author is working from the basis that homo sapiens are the only sapient species, that is just a given, and there's no real interest in exploring otherwise.
Fair, this stuff is never straightforward! I guess that’s gonna depend on how we’re defining whatever quality we’re measuring, which I was deliberately fuzzy on because I don’t have the best handle on what consciousness is (do any of us, really?), let alone sentience or sapience.
It does sound like you’re on a similar page about complexity being important, though? Even if you’re putting the boundary lower than I did - maybe from a philosophical or biological difference of opinion, maybe from a semantic one on what we’re defining - the idea that there is a gradient of some kind and a reasonable cutoff point still seems to be shared.
Honestly the only thing that’s really surprised me in this thread is from @AnEarlyMartyr - the idea of putting bacteria as a stronger maybe is a slight surprise to me, not a wild one, but doing so and confidently ruling out LLMs genuinely doesn’t fit within my worldview! For the record, I’m absolutely not of the opinion that current LLMs are conscious, although I see no reason to rule out machine consciousness as a possibility in general (even if perhaps only in the far far future). I just struggle to ascribe a “maybe there’s emergent behaviour there that we don’t understand” to a biological machine like a bacterium or a fly without being forced to ascribe the same thing to a trillion parameter ball of statistical input/output processing.
Personally, I'm a bit of a biological chauvinist; i.e., my prior is that organic brains are more likely to be conscious than non-organic "brain-like things" of similar or even greater complexity. Actually, I have some doubt that digital brains can ever be conscious on any scale of complexity.
I'd personally say insects and below are just biological automata. But mice/fish are where I begin to entertain some shade of gray on the consciousness scale.
I question insects on some level. I know that butterflies were proven to retain memories as caterpillars by a 10-year-old Japanese boy, who first got curious because he noticed that butterflies he'd raised from caterpillars would fly back to him when he tried to release them. Which is super sweet and adorable, and highlights to me that the caterpillars/butterflies at least recognized him and considered him "safe".
On a personal level, I remember one stinkbug at our old house spent probably half an hour just crawling up and down a charging cable slung over the end table. It'd reach one end, turn around, crawl the other way, then turn around and repeat. It could've easily hopped off at any point after reaching a dead end, or onto the table while the cable crossed over it, but it seemed totally content to just crawl endlessly until I caught it to take outside. We had a lot of stinkbugs get in that house, but none of them behaved like that. The only explanations I can come up with are some variation of it either found that fun, or it was particularly stupid, both of which imply some level of thought/intelligence.
Of course, we may very well just be reading too much into it. Humans have an instinct to humanize everything. But who knows? Our understanding of sentience is automatically biased towards... Well, brains. Insects may have some different form of "sentience" and/or consciousness that we haven't considered.
I dunno. I have a shrimp tank and even these bottom feeders have some personality to them.
Maybe some of that is just that human tendancy to humanise everything. My pet rock has some personality if you stare at it long enough.
People humanize their cats in Minecraft. I don’t think being able to see some kind of humanity in a living thing means it must have anything like a human experience.
I agree. Consciousness scales with complexity. I'm not sure exactly what that line looks like either. Even just looking at a human. I think we can agree that a single brain cell kept alive in a petri dish would be unlikely to be conscious. So there must be a threshold. Humans are complex with hormone squirting glands and electric signal flinging brain cells. How much, and what parts are needed to support consciousness?
Consciousness as a function of complexity is interesting. I consider myself maximally "conscious" but I have nothing to back that up. Theoretically something sufficiently complex could become more conscious than human? Is there a cap to this or does the level consciousness continue to scale with complexity to infinity?
Even humans are not really maximally conscious. A lot of our thought processes are done unconsciously, like language generation and most decision making. We are only aware of a portion of our internal processing, and even that awareness is pretty inconsistent (e.g., blanking out while driving your regular commute).
If I understand correctly that's an evolutionary adaptation that's beneficial to us. So a being that is more complex than us I wouldn't think would necessarily have less of the unconscious hidden away from them, maybe they'd have even more to allow more focus on other, more important things.
To your point though, I guess It doesn't make sense to call myself "maximally conscious" without access to those parts of me. I'll have to rethink that.
See this is also really interesting! It’s kinda tough properly discussing something that we don’t entirely know how to define, but I was envisaging it more as a cutoff point of some kind (a necessarily fuzzy one, as all things are when they hit reality, but a cutoff nonetheless) where we err on the side of caution in the grey area but largely define above the line as above the line in a binary sense.
But then I suppose I am inherently considering a gradient on some axis too (possibly a different axis?) because I have different concerns about what I’d consider ethical treatment of creatures at different points on the list. It’s a fascinating topic, that’s for sure!
I don't think we actually know that complexity is the right metric. I mean, I think it's undeniable that with greater complexity you can make something that seems more conscious; but just because something seems more conscious, or can convince more people, doesn't necessarily mean that it is conscious.
There was a paper a couple months back that presented possible evidence of quantum effects in the brain. If that's true (and I have no idea) then it could be that consciousness doesn't actually require all that much complexity, but it does require these weird quantum effects.
That being said, maybe it doesn't really matter? If something is complex enough that it can do useful stuff, then whether it is conscious is really more of a philosophical / ethical question.
Was that Roger Penrose, by any chance? I was fortunate enough to be at one of his talks a few years back, and he dipped into theory of consciousness among a lot of other fascinating topics. I can certainly believe the conceptual idea that as-yet-unexplored quantum effects, and/or higher-order interactions in the structure of the electrical fields of the neurons far beyond the signal:response “circuitry” we can currently analyse could be crucial.
We’re definitely in deep “nobody really knows yet” territory, which I always find exciting! I’ll admit I find it hard to conceptualise a “brain” that could trigger these kind of interactions we don’t even yet understand without being fairly complex - even if complex in ways we can’t yet measure - but as you say, we don’t know anything for sure right now.
I tried to figure out where I read about it, but no luck. Some searching revealed that there have been a bunch of papers published in the last few years with similar findings or conjectures, so maybe it's not so far-fetched.
It matters…, it matters a whole lot in my opinion!
I see where you’re coming from with it, but I don’t think this idea generalizes to a (potential) future time full of technological advances, under the assumption that we want – at minimum – human beings to be governed under some general principles of nicety, such as the UN's universal human rights declaration.
This was probably a bit abstract. For one example of what I’m talking about: MMAcevedo is a sci-fi-horror “Wikipedia“-style entry, but regardless of that, I’ve turned into a stark opponent of most anything related to brain-scanning and -uploading (whereas before reading it I would’ve considered myself to be neutral towards, maybe even curious about such a future technology). Being sapient or sentient suddenly matters a lot more if you could be made to experience orders of magnitude more things (hours, tasks, emotion, pain signals) than any biological organism was ever meant to live through. That’s dangerous territory!
Now consider this thought experiment: What happens if one day, we actually succeeded in producing working/runnable brain scans, and it hypothetically were to turn out that their internal structure can be transformed to be basically an identical match to how LLMs’ matrices work and look like – would we still feel comfortable sending these machines out to do “useful stuff“ for us, with no limitation on the content or duration of work done?
Could we still treat machines that, while built in a wholly different way, internally function just like a “human [scan]“ as non-sentient? Or, reverse that and conclude that not even humans deserve the rights we fundamentally admitted to sentient/sapient beings?
There is a competing view that maybe everything actually is conscious, but if you dont think about it then it doesnt really matter in a meaningful way.
Like, maybe rocks are actually conscious but since they dont have the capacity to think they cant really suffer or fall in love or anything so nobody cares, its just an eternity of being aware of heat or pressure or whatnot.
And then as you go into various forms of life you develop sophisticated systems for sensing and responding to the environment, and that consciousness starts mattering more because it somehow couples into those complex systems and affects how living things behave.
And then eventually at the tier of life humans are at, you develop self awareness and that amplifies the significance of consciousness in some sense, which is why we think of there being a cutoff between chimps and ants.
I’m not sure how implementing a perception in AoE is supposed to indicate anything.
Do they not know what a Turing machine is? You can often contrive ways for programs running on a Turing machine to themselves be Turing complete. Many video games apply. So do unexpected things like CSS or the c++ preprocessor.
Unless you believe it is completely impossible for a Turing machine to represent consciousness, then it will be possible theoretically to construct said machine consciousness in Minecraft or whatever, because Minecraft is Turing complete. It do be like that.
I've been increasingly annoyed with coverage from 404 Media on the topic of AI. It just seems to me that they're pessimistic and gleefully contrarian on the subject despite the clear advances in the field. I've not seen them lose one kind word about modern attention-aware transformers.
Of course, they're not obliged to, anyone can write what they want, but it does to me paint a pattern. They're just all too ready to jump on any story that even slightly antagonises "AI", as if that means anything.
This article in specific requires a broken premise. I don't think any researcher worth their weight in salt is saying that any LLM currently in development or on the market is, has ever been, or can be conscious.
I don't think I need to expand on this, but if anyone's curious, here's a collection of articles that I thought were particularly uncharitable and really only read to me as gawking at the (admittedly numerous and very funny) failures symptomatic of an industry in a state of panicked flailing.
It Is Trivially Easy to Use Reddit to Manipulate AI Search, Research Suggests
Software Developers Say AI Is Rotting Their Brains
Anthropic Promises Trump Admin Its AI Is Not Woke
I had discovered 404 via artists on Fedi, so if they exist at that intersection of art and technology the hostilities toward genAI in particular make sense.
But I also don't understand how you consider that Trump one in particular uncharitable at all. Best I can tell it's not even criticizing the tech so much as the ignoramus in chief and companies kowtowing to his bigotry.
There is also something to be said that they do substantial investigative journalism. And generally speaking, that means reporting on the dirty underbelly than the squeaky clean PR releases.
Hopefully this doesnt end up being a schrodingers box scenario.
The LLM is radioactive and possibly dead?
Schrodinger originally came up with that metaphor to clown on the Copenhagen interpretation, but now its just what everyone goes to as their default explanation of quantum mechanics.
I know, I was making a joke