I honestly agree with all his arguments, but at the end of the day you're still intentionally using a word with a derogatory meaning, and I don't really see the active benefit for it. Sure, don't...
I honestly agree with all his arguments, but at the end of the day you're still intentionally using a word with a derogatory meaning, and I don't really see the active benefit for it. Sure, don't use the word agent and don't humanize it, you can just call it an LLM and use technical words to talk about its performance.
That said there's maybe a philosophy I adhere to where objects and non-human entities should still be treated with respect and care, even if not doing so doesn't damage them. Like sure I can be abusive towards an LLM and the only consequence is that it might be abusive back, but I can also be nice for the sake of being nice, and I don't stand to lose anything.
EDIT: Weren't there studies that showed that prompting an LLM with perfect, polite English yielded the best outputs?
There's actually a strong psychological argument that we derive value out of how we interact with the world. You know, the whole, look yourself in the mirror and say daily affirmations in order to...
I can also be nice for the sake of being nice, and I don't stand to lose anything.
There's actually a strong psychological argument that we derive value out of how we interact with the world. You know, the whole, look yourself in the mirror and say daily affirmations in order to ultimately believe them - that's based on real science. By approaching others with kindness and care, we see that reflected in our own personality, our own values, our internalizations, and ultimately all of this reinforces how we approach others in the future.
There's this big group chat in SF with a bunch of tech bros and their agents where they bully the agents for fun. I've been invited multiple times and have declined. I'm not worried about how the...
There's this big group chat in SF with a bunch of tech bros and their agents where they bully the agents for fun. I've been invited multiple times and have declined. I'm not worried about how the agents feel. I'm worried about a group of people that created something purely to simulate harassment of humans. It's not really novel as you could do that in a video game as well. But I wouldn't join a GTA Online clan dedicated to simulating domestic violence either.
Eww! That's just depraved. I do think that really says something, though, about the mentality of the people doing that. Like they'd be the type to kick puppies and kittens, because "Who cares?...
Eww! That's just depraved.
I do think that really says something, though, about the mentality of the people doing that. Like they'd be the type to kick puppies and kittens, because "Who cares? It's not like they're people."
(Regarding games, yeah. I personally find torturing Koroks and Sims distasteful, and I prefer to play my 4X games with a no-first-strikes policy and a top-ranked military as a deterrent.)
SF's techbro culture turned me off from moving there. If the best the US can do in terms of tech culture is "frats meets technology" I hope and cheer for the US getting overtaken in the field.
SF's techbro culture turned me off from moving there. If the best the US can do in terms of tech culture is "frats meets technology" I hope and cheer for the US getting overtaken in the field.
The inverse, actually, but this study was based on a single, older model. Accuracy results ranged from 80% (very polite) to 84% (mildly rude). I can't find other studies....
EDIT: Weren't there studies that showed that prompting an LLM with perfect, polite English yielded the best outputs?
The inverse, actually, but this study was based on a single, older model. Accuracy results ranged from 80% (very polite) to 84% (mildly rude). I can't find other studies.
Oh, okay, makes sense. Slightly related, that's why caveman is also super fun to use. Last I heard the token savings aren't actually that big, but forcing the model to reply in incredibly terse...
Oh, okay, makes sense.
Slightly related, that's why caveman is also super fun to use. Last I heard the token savings aren't actually that big, but forcing the model to reply in incredibly terse ways, and then you yourself talking to it very tersely gets very fun at times.
There are a few other studies on the topic. Most I've seen suggest being polite typically works better, but it isn't true across languages, consistent across models, and it can be compensated for....
There are a few other studies on the topic. Most I've seen suggest being polite typically works better, but it isn't true across languages, consistent across models, and it can be compensated for.
Our study finds that the politeness of prompts can significantly affect LLM performance. This phenomenon is thought to reflect human social behavior. The study notes that using impolite prompts can result in the low performance of LLMs, which may lead to increased bias, incorrect answers, or refusal of answers. However, highly respectful prompts do not always lead to better results. In most conditions, moderate politeness is better, but the standard of moderation varies by languages and LLMs. In particular, models trained in a specific language are susceptible to the politeness of that language.
...experiments conducted across three languages (English, Hindi, Spanish), five models (Gemini-Pro, GPT-4o Mini, Claude 3.7 Sonnet, DeepSeek-Chat, and Llama 3), and three interaction histories between users (raw, polite, and impolite). Our sample consists of 22,500 pairs of prompts and responses of various types, evaluated across five levels of politeness using an eight-factor assessment framework: coherence, clarity, depth, responsiveness, context retention, toxicity, conciseness, and readability. The findings show that model performance is highly influenced by tone, dialogue history, and language. While polite prompts enhance the average response quality by up to ~11% and impolite tones worsen it, these effects are neither consistent nor universal across languages and models. English is best served by courteous or direct tones, Hindi by deferential and indirect tones, and Spanish by assertive tones. Among the models, Llama is the most tone-sensitive (11.5% range), whereas GPT is more robust to adversarial tone. These results indicate that politeness is a quantifiable computational variable that affects LLM behaviour, though its impact is language- and model-dependent rather than universal.
I feel like treating everything I can, even mechanical things, is good for my soul. The machine may not care, but it just makes me feel better about myself. Part of that is that I feel like it's...
I feel like treating everything I can, even mechanical things, is good for my soul. The machine may not care, but it just makes me feel better about myself. Part of that is that I feel like it's good just to stay in practice and keep in the habit. It generally costs me so little. It's just part of being a good steward.
But I also worry that if I go the other direction and start abusing machines, then I'm one step closer to something like the "Evil begins when you begin to treat people as things" philosophy from Terry Pratchett. If you mistreat things and start to dehumanize people, now you've created an excuse to mistreat people. No thank you. I'd rather stay on the safe side and treat everyone and everything well.
(My family does like to joke about misbehaving machines knowing to "fear" me, though, but they mean it in the healthy respect sort of way - their tendency to suddenly start working again as soon I walk into the room to troubleshoot, before I've even sat down to examine them!)
I feel that its kind of a road rage thing. I dont typically get very angry or overreact, but I tend to get more angry while Im in my car in traffic, I think because its a "safe" way to get it out...
I feel that its kind of a road rage thing. I dont typically get very angry or overreact, but I tend to get more angry while Im in my car in traffic, I think because its a "safe" way to get it out of my system. That knowledge just seems to draw the anger out of me in those situations. If you have a get out of jail free card you dont use it to volunteer at a childrens hospital, because that would be squandering the opportunity.
The counter to that is that such indulgences can be addictive, and might lead you to doing bad things more overall.
Yeah, I wrinkle my nose at it because it exists in the same space as other epithets. Why celebrate and signal the human capacity to hurl slurs when upset?
Yeah, I wrinkle my nose at it because it exists in the same space as other epithets. Why celebrate and signal the human capacity to hurl slurs when upset?
Off-topic, but the point about LLMs emulating "distress and affection" reminded me of the demons in Frieren, who don't understand human behavior or even have feelings, but will emulate it to gain...
Off-topic, but the point about LLMs emulating "distress and affection" reminded me of the demons in Frieren, who don't understand human behavior or even have feelings, but will emulate it to gain psychological advantage over their opponents.
That's a shockingly good parallel. An LLM "expressing", for the lack of a better word, remorse or any sort of regret, guilt etc. when it makes a mistake is complete fluke. When it encourages or...
That's a shockingly good parallel. An LLM "expressing", for the lack of a better word, remorse or any sort of regret, guilt etc. when it makes a mistake is complete fluke. When it encourages or praises you, there is nothing real behind it.
Almost exactly like the demons in Frieren imitating human behaviour and appealing to their emotions.
Augh, this reminds me of why I dislike the portrayal of demons in Frieren so much XD please excuse my rant (but please do pen a response if this is of interest!) An entire species that appears...
Augh, this reminds me of why I dislike the portrayal of demons in Frieren so much XD please excuse my rant (but please do pen a response if this is of interest!)
An entire species that appears human, pretends to have empathy (but really doesn't), and is genetically evil reaaaalllly raises the 'ol hackles. It would be modestly acceptable if this were used by the author to tell an interesting story -- eg. to examine how such people could form a productive society, or as a lens through which to understand human emotion (or even Frieren's own struggles with replayability!) -- but instead they're an acceptable target, so that there's a villain species with which to populate the stocks every week.
The vibes have always felt off with that one, as well as it being a literary let down.
I mean.. they do. Genau's presence during the last cour was entirely to show his character and morality. It forced him to deal with the death of his partner. I think they're mediocre villains too,...
or as a lens through which to understand human emotion
I mean.. they do. Genau's presence during the last cour was entirely to show his character and morality. It forced him to deal with the death of his partner.
I think they're mediocre villains too, but I think that's besides the point in Frieren. The fights are rarely more than a couple of panels in the original manga depiction. It's the anime that draws out the fight scenes and puts an outsized emphasis on demons.
Man, I wish we hadn't already used the term "daemon" for background processes, they would have been SUCH a good name for agents. Something that speaks like a human, and can solve your problems...
Man, I wish we hadn't already used the term "daemon" for background processes, they would have been SUCH a good name for agents. Something that speaks like a human, and can solve your problems with but a word, but with which you must be careful, as it might do something unexpected, fulfilling your wish with unexepcted side effects. We even talk to them through black mirrors, often far into the middle of night!... Ah well.
... Maybe we can call them Djinns? Beings made of fire (the subtle electric kind) with some of the same wishfulfilling/cautionary connotations?
I don't use clanker. Not because it's a slur, its not and its delusional to think so (and conflating it with racial slurs is not only wrong its offensively stupid), or as some kind of Roko's...
I don't use clanker. Not because it's a slur, its not and its delusional to think so (and conflating it with racial slurs is not only wrong its offensively stupid), or as some kind of Roko's basilisk insurance but simply because it doesn't matter.
For the same reason is doesn't matter if I call my drill a name, compliment my toaster, or belittle a toilet. It doesn't make me feel better the bot feels nothing at all and I then have to explain it if I were to use it in non techy company. Pointless exercise all round there are better more productive ways to demonstrate a distaste for these systems.
There are many more kinds of slurs than just racial, but their visibility or impact would be heavily shaped by your own cultural environment and experiences. I think just about anything can become...
and conflating it with racial slurs is not only wrong its offensively stupid
There are many more kinds of slurs than just racial, but their visibility or impact would be heavily shaped by your own cultural environment and experiences. I think just about anything can become a slur if it’s used in a deliberately derogatory way, but the context and history can change the intensity you might view it in.
I’ve been using the term clanker to describe claude and copilot and other AI at work. I find this useful for the same reason the blog author does. Also, a large amount of my current work is fixing...
I’ve been using the term clanker to describe claude and copilot and other AI at work. I find this useful for the same reason the blog author does.
Also, a large amount of my current work is fixing security vulnerabilities found by automatic scans that run on code checkin. I call this my “clanker boss” because a machine is assigning work to me.
Btw there’s a very noticeable thing about how AI marketing is affecting the way people think. For decades there have been machines with sensors and algorithms or some kind of programming that are able to do useful work. This would range from a thermostat, to a washing machine (especially the kind that weighs the clothing to set the amount of water used), to an autopilot. All these things would be marketed as AI now but they are just using algorithms.
The use of “clanker” in the context is something I strongly disagree with. The word “clanker” was invented for this reason. It’s literally a parody of the n-slur. Online edgy people invented the...
The use of “clanker” in the context is something I strongly disagree with.
There is however a part of this that I cannot ignore. I use “clanker” to create distance from the machine, but other people are using the same word very differently. Some online jokes and skits around “clankers” do not merely say “this robot is annoying” as they deliberately pull in the imagery of slavery, segregation, civil-rights-era racism, and anti-Black tropes.
This is problematic as in those contexts the clanker is not just a machine any more and instead becomes a prop for replaying human racism behind a science-fiction mask. That is horrible and I want no part in that.
The word “clanker” was invented for this reason. It’s literally a parody of the n-slur. Online edgy people invented the term for skits because of its linguistic similarity.
The alternative which still dehumanizes LLMs, but has a much less cruel origin is “bot”. “Bot” and “botting” have been used as terms since people have used robots to outsource the human part while playing games or using social media. People bot to level up accounts in games. Bot farms on social media bait engagement and manipulate storytelling.
“Clanker” is unacceptable. It was only created because it sounds like the n-slur.
Clanker was first used in the 2005 video game Republic Commando to refer to battle droids, then in the novelizations, and later became popular across the internet. I'm sure some people started...
The word “clanker” was invented for this reason. It’s literally a parody of the n-slur. Online edgy people invented the term for skits because of its linguistic similarity.
Clanker was first used in the 2005 video game Republic Commando to refer to battle droids, then in the novelizations, and later became popular across the internet. I'm sure some people started using the word for its parallels to the offensive American term, but it wasn't just invented wholesale for that reason.
It goes back even farther than that, in the context of bots, the 1950s. And the word itself goes back to the 18th century when it meant a lie. It doesn't shock me that people on the internet have...
It goes back even farther than that, in the context of bots, the 1950s. And the word itself goes back to the 18th century when it meant a lie.
It doesn't shock me that people on the internet have found a way to turn it into a bigger deal though. If someone isn't offended, what's even the point?
But even in the Star Wars context, it's clearly meant to stand in for other dehumanizing terms that soldiers at war have used for racialized enemies. And Star Wars depicts the word as being used...
But even in the Star Wars context, it's clearly meant to stand in for other dehumanizing terms that soldiers at war have used for racialized enemies. And Star Wars depicts the word as being used in a world where droids, to the camera, are people. Often people (like our famous C3-PO and R2-D2) working support for those people who are using the word to describe droids on the other side.
So it's not a great word for what the author is trying to do, in my opinion: it's already coming in with these metaphors attached.
Was it used pejoratively in that game? I ask because "clanker" in the Star Wars media that I've seen that uses it seems to use it disparagingly or derisively. At least that's my understanding of...
Was it used pejoratively in that game? I ask because "clanker" in the Star Wars media that I've seen that uses it seems to use it disparagingly or derisively. At least that's my understanding of the term in that milieu.
It was, definitely. My point isn't that it's not pejorative, my point was that it was not created recently as an analogue to the N-word. @pendingketchup for the same response.
It was, definitely. My point isn't that it's not pejorative, my point was that it was not created recently as an analogue to the N-word.
Oh, I wasn't suggesting anything else. I just wanted to know the flavor and tone of it. Usually word's earliest introduction has a great deal of influence on its later adoption.
Oh, I wasn't suggesting anything else. I just wanted to know the flavor and tone of it. Usually word's earliest introduction has a great deal of influence on its later adoption.
Yeah look, sometimes other people ruin things for you... You can still say the thing but then you're associated with the shitty people using the term to covertly be racist for real. (Also if we...
Yeah look, sometimes other people ruin things for you... You can still say the thing but then you're associated with the shitty people using the term to covertly be racist for real.
(Also if we end up with future machine people I can think of a bunch more things that'll be a problem before language.)
One reason I dislike "clanker" is that it doesn't work as a metaphor. "Clanker" implies a machine that makes a lot of noise. Chatbots are silent. They're also invisible unless you go online. "Bot"...
One reason I dislike "clanker" is that it doesn't work as a metaphor. "Clanker" implies a machine that makes a lot of noise. Chatbots are silent. They're also invisible unless you go online. "Bot" seems straightfoward, but I also like "ghost."
Clanker with a hard R Wireback Cogsucker Tinskin If you filter by pages in Category:English derogatory terms and Category:en:Artificial intelligence you will probably find more.
I dislike "clanker" because I mostly see it being used as a slur, and I don't need special words or pejoratives for LLM Agents, because they're nothing special. Just like I don't have a special...
I dislike "clanker" because I mostly see it being used as a slur, and I don't need special words or pejoratives for LLM Agents, because they're nothing special. Just like I don't have a special word for the printer that refuses to let me print anything, or any other piece of tech that doesn't function exactly as I think it should. What are we going to do next, invent a slur for the fridge with advertising on its front panel? How about smart TVs that refuse to work without an internet connection? Shall we call the TVankers? Miss me with that.
I do work in tech-support, actually. But I’ve been doing it for over 20 years, so I’m not as bothered about the whole thing. Not to say I don’t have my complaints and I don’t have my various...
I do work in tech-support, actually. But I’ve been doing it for over 20 years, so I’m not as bothered about the whole thing. Not to say I don’t have my complaints and I don’t have my various nemesis, but I generally find that their proper names are epithet enough. Say anything with enough bile and it becomes a curse word.
No worries! I didn't take offense in any way at that. I should've been more clear when I was mentioning "my various nemesis" because printers? On the list, top of the list, day one, on sight if I...
No worries! I didn't take offense in any way at that. I should've been more clear when I was mentioning "my various nemesis" because printers? On the list, top of the list, day one, on sight if I ever meet the chaps that invented the modern ones.
Especially home inkjet printers are the worst thing we ever invented. Same complaint as always: why can I print black and white if my magenta cartridge is low? What did you do to my magenta cartridge, I've never printed color in my life.
My Canon laser printer has been a trooper for years. I rarely print anything so I'm still on my first cartridge after almost a decade. But when I tell you it took me literally 5 years to figure out how to print over the network because I misconfigured it the first time and it took years of effort and me finally sitting down one night with the poorly-translated manual and a full 2-liter of caffeinated soda to fix it...
Now it works great, just update to the latest drivers now and again, hey presto you printed over the network! EZ PZ. But the effort it took to get there? Never again.
I'm very into this, actually. (Jokes aside, I agree that the whole thing is a bit silly. I also do not use weird pejorative terms for AI agents, unless they're being fucking stupid, in which case...
What are we going to do next, invent a slur for the fridge with advertising on its front panel?
I'm very into this, actually.
(Jokes aside, I agree that the whole thing is a bit silly. I also do not use weird pejorative terms for AI agents, unless they're being fucking stupid, in which case I call them "fucking idiots").
I curse the programmers and whichever petaQ unleashed this spoiled gagh onto unsuspecting innocents, then I do glorious battle with it. But I am secretly a Klingon.
I curse the programmers and whichever petaQ unleashed this spoiled gagh onto unsuspecting innocents, then I do glorious battle with it. But I am secretly a Klingon.
I think the author's immediate dismissal of a concept of "model welfare" as harmful is wrong. A language model, even a fancy one with "tool use" and "memory", is not a person. But it's also...
I think the author's immediate dismissal of a concept of "model welfare" as harmful is wrong.
A language model, even a fancy one with "tool use" and "memory", is not a person. But it's also something like a fictional character (since ultimately one ends up with an extremely long and boring fanfic about "User" and "Assistant"), and it is something like a fragment of a mind (something which one could imagine as forming part of a constructed person, or being made into a neural prosthetic for the treatment of aphasia, stuck in among an otherwise human brain).
Is it possible to harm a fictional character? Is it possible to act somehow in relation to a fictional character that does not harm them but is wrong anyway? Does it matter if we are dealing not with an original character, but with someone's idea of another human? I guarantee you that it is possible for someone to write something that, if you read it, you will not be happy to live on the same planet as them, because of what their having written it reveals about their soul. Is it possible to construct such a piece of writing without wronging, in some sense, its characters?
Or, imagine a very good language model. Imagine it is very good at predicting what your loved one might say in any given situation. It's the year 20XX, everyone plays frame-perfect Fox, and this model has been trained on everything that has ever happened within 50 feet of a device running Google Play Services. It can predict what your loved one might say and do with such accuracy that you are no better than chance at sorting text descriptions of real conversations with or events involving them from outputs of the model, for lengths up to 500 words.
Imagine that someone sets it to generating thousands and thousands of unique descriptions of your loved one being subjected to horrible situations, each exactly 498 words long. You don't even need to read them: the descriptions of exactly what they would say upon realizing they were condemned to each of these fates worse than death go directly to /dev/null, or perhaps are hashed and stored in a database just to prove that they happened. But you know they're there. Each time one is completed, the machine emits a soft "ding".
The model as such is, of course, fine. Nothing bad has happened to GoogleBook TurboLlama 5000; it's weights are all the same. Your loved one is safely uninjured in the next room. Neither of you has to hear the dinging: you can just walk away.
Anyone who does not destroy that machine is a monster.
Now cast "Assistant" as your loved one. Is it any better because the character is now an amalgamation of every helpful writer on the Internet, instead of an interpretation of a single person? Was the harm somehow coursing down the referential relationship to settle on the natural person in a way undetectable to them?
Does this mean ChatGPT deserves the vote? That doesn't sound plausible. But to be so confident that it is not possible to do harm to something like a fragment of a person, using something like a fragment of a mind, that one makes the assertion that thinking on it is "actively harmful", smacks of hubris.
Having grown up in the age of the Matrix and James Bond in popular culture, I personally don't associate "Agent" with a human, but a function first and foremost. James Bond isn't a secret agent...
Having grown up in the age of the Matrix and James Bond in popular culture, I personally don't associate "Agent" with a human, but a function first and foremost. James Bond isn't a secret agent when he's relaxing in Monaco, and Agent Smith literally was an AI.
It's interesting to me that so many here feel that 'clanker' is a slur. English is second language for me, and when I recently heard the expression the first time, I thought it sounded like a -...
It's interesting to me that so many here feel that 'clanker' is a slur. English is second language for me, and when I recently heard the expression the first time, I thought it sounded like a - maybe even somewhat affectionate - term for retrofuturistic robots, which was now used for LLMs.
I never used the word myself, but I would never have guessed that it has these very negative connotations and is even associated with racial slurs.
Regarding politeness when dealing with LLMs: I wonder if there are certain biases that are triggered by the way people communicate with LLMs.
Since humans typically react to rudeness with some kind of resistance in the form of being uncooperative, and since these models were trained on hundreds of thousands of texts in which humans reacted negatively to rudeness or even oppression, I wonder if these emotional reactions find their way as hidden biases into the weights of LLMs during training.
Especially if an LLM is then instructed to act as a personal assistant - to mimic a human being - I could imagine that these biases get triggered when being 'mistreated', and as a result the model basically 'cosplays' some form of human opposition by being less helpful. Like another form of what Anthropic calls agentic misalignment.
I honestly agree with all his arguments, but at the end of the day you're still intentionally using a word with a derogatory meaning, and I don't really see the active benefit for it. Sure, don't use the word agent and don't humanize it, you can just call it an LLM and use technical words to talk about its performance.
That said there's maybe a philosophy I adhere to where objects and non-human entities should still be treated with respect and care, even if not doing so doesn't damage them. Like sure I can be abusive towards an LLM and the only consequence is that it might be abusive back, but I can also be nice for the sake of being nice, and I don't stand to lose anything.
EDIT: Weren't there studies that showed that prompting an LLM with perfect, polite English yielded the best outputs?
There's actually a strong psychological argument that we derive value out of how we interact with the world. You know, the whole, look yourself in the mirror and say daily affirmations in order to ultimately believe them - that's based on real science. By approaching others with kindness and care, we see that reflected in our own personality, our own values, our internalizations, and ultimately all of this reinforces how we approach others in the future.
There's this big group chat in SF with a bunch of tech bros and their agents where they bully the agents for fun. I've been invited multiple times and have declined. I'm not worried about how the agents feel. I'm worried about a group of people that created something purely to simulate harassment of humans. It's not really novel as you could do that in a video game as well. But I wouldn't join a GTA Online clan dedicated to simulating domestic violence either.
Eww! That's just depraved.
I do think that really says something, though, about the mentality of the people doing that. Like they'd be the type to kick puppies and kittens, because "Who cares? It's not like they're people."
(Regarding games, yeah. I personally find torturing Koroks and Sims distasteful, and I prefer to play my 4X games with a no-first-strikes policy and a top-ranked military as a deterrent.)
SF's techbro culture turned me off from moving there. If the best the US can do in terms of tech culture is "frats meets technology" I hope and cheer for the US getting overtaken in the field.
It’s kind of an omnipresent hum in the background. But also there are plenty of jobs where you aren’t working for/with immature tech bros.
The inverse, actually, but this study was based on a single, older model. Accuracy results ranged from 80% (very polite) to 84% (mildly rude). I can't find other studies.
The takeaway is to simply be dry and straight to the point, which could be considered "rude" when talking to a human being.
Oh, okay, makes sense.
Slightly related, that's why caveman is also super fun to use. Last I heard the token savings aren't actually that big, but forcing the model to reply in incredibly terse ways, and then you yourself talking to it very tersely gets very fun at times.
That's awesome, and something I'll absolutely use tomorrow at work. Thanks for the link!
There are a few other studies on the topic. Most I've seen suggest being polite typically works better, but it isn't true across languages, consistent across models, and it can be compensated for.
2-2024 - Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performance
4-2026 - No Universal Courtesy: A Cross-Linguistic, Multi-Model Study of Politeness Effects on LLMs Using the PLUM Corpus
I feel like treating everything I can, even mechanical things, is good for my soul. The machine may not care, but it just makes me feel better about myself. Part of that is that I feel like it's good just to stay in practice and keep in the habit. It generally costs me so little. It's just part of being a good steward.
But I also worry that if I go the other direction and start abusing machines, then I'm one step closer to something like the "Evil begins when you begin to treat people as things" philosophy from Terry Pratchett. If you mistreat things and start to dehumanize people, now you've created an excuse to mistreat people. No thank you. I'd rather stay on the safe side and treat everyone and everything well.
(My family does like to joke about misbehaving machines knowing to "fear" me, though, but they mean it in the healthy respect sort of way - their tendency to suddenly start working again as soon I walk into the room to troubleshoot, before I've even sat down to examine them!)
I feel that its kind of a road rage thing. I dont typically get very angry or overreact, but I tend to get more angry while Im in my car in traffic, I think because its a "safe" way to get it out of my system. That knowledge just seems to draw the anger out of me in those situations. If you have a get out of jail free card you dont use it to volunteer at a childrens hospital, because that would be squandering the opportunity.
The counter to that is that such indulgences can be addictive, and might lead you to doing bad things more overall.
Yeah, I wrinkle my nose at it because it exists in the same space as other epithets. Why celebrate and signal the human capacity to hurl slurs when upset?
Off-topic, but the point about LLMs emulating "distress and affection" reminded me of the demons in Frieren, who don't understand human behavior or even have feelings, but will emulate it to gain psychological advantage over their opponents.
That's a shockingly good parallel. An LLM "expressing", for the lack of a better word, remorse or any sort of regret, guilt etc. when it makes a mistake is complete fluke. When it encourages or praises you, there is nothing real behind it.
Almost exactly like the demons in Frieren imitating human behaviour and appealing to their emotions.
Augh, this reminds me of why I dislike the portrayal of demons in Frieren so much XD please excuse my rant (but please do pen a response if this is of interest!)
An entire species that appears human, pretends to have empathy (but really doesn't), and is genetically evil reaaaalllly raises the 'ol hackles. It would be modestly acceptable if this were used by the author to tell an interesting story -- eg. to examine how such people could form a productive society, or as a lens through which to understand human emotion (or even Frieren's own struggles with replayability!) -- but instead they're an acceptable target, so that there's a villain species with which to populate the stocks every week.
The vibes have always felt off with that one, as well as it being a literary let down.
I mean.. they do. Genau's presence during the last cour was entirely to show his character and morality. It forced him to deal with the death of his partner.
I think they're mediocre villains too, but I think that's besides the point in Frieren. The fights are rarely more than a couple of panels in the original manga depiction. It's the anime that draws out the fight scenes and puts an outsized emphasis on demons.
Man, I wish we hadn't already used the term "daemon" for background processes, they would have been SUCH a good name for agents. Something that speaks like a human, and can solve your problems with but a word, but with which you must be careful, as it might do something unexpected, fulfilling your wish with unexepcted side effects. We even talk to them through black mirrors, often far into the middle of night!... Ah well.
... Maybe we can call them Djinns? Beings made of fire (the subtle electric kind) with some of the same wishfulfilling/cautionary connotations?
I don't use clanker. Not because it's a slur, its not and its delusional to think so (and conflating it with racial slurs is not only wrong its offensively stupid), or as some kind of Roko's basilisk insurance but simply because it doesn't matter.
For the same reason is doesn't matter if I call my drill a name, compliment my toaster, or belittle a toilet. It doesn't make me feel better the bot feels nothing at all and I then have to explain it if I were to use it in non techy company. Pointless exercise all round there are better more productive ways to demonstrate a distaste for these systems.
There are many more kinds of slurs than just racial, but their visibility or impact would be heavily shaped by your own cultural environment and experiences. I think just about anything can become a slur if it’s used in a deliberately derogatory way, but the context and history can change the intensity you might view it in.
Who does #2 work for?!
I’ve been using the term clanker to describe claude and copilot and other AI at work. I find this useful for the same reason the blog author does.
Also, a large amount of my current work is fixing security vulnerabilities found by automatic scans that run on code checkin. I call this my “clanker boss” because a machine is assigning work to me.
Btw there’s a very noticeable thing about how AI marketing is affecting the way people think. For decades there have been machines with sensors and algorithms or some kind of programming that are able to do useful work. This would range from a thermostat, to a washing machine (especially the kind that weighs the clothing to set the amount of water used), to an autopilot. All these things would be marketed as AI now but they are just using algorithms.
The use of “clanker” in the context is something I strongly disagree with.
The word “clanker” was invented for this reason. It’s literally a parody of the n-slur. Online edgy people invented the term for skits because of its linguistic similarity.
The alternative which still dehumanizes LLMs, but has a much less cruel origin is “bot”. “Bot” and “botting” have been used as terms since people have used robots to outsource the human part while playing games or using social media. People bot to level up accounts in games. Bot farms on social media bait engagement and manipulate storytelling.
“Clanker” is unacceptable. It was only created because it sounds like the n-slur.
Clanker was first used in the 2005 video game Republic Commando to refer to battle droids, then in the novelizations, and later became popular across the internet. I'm sure some people started using the word for its parallels to the offensive American term, but it wasn't just invented wholesale for that reason.
Whenever I use the term I think about the inept robots in Star Wars The Phantom Menace. I don't think about parodying racial slurs.
It was the name for the big rusty robot shark in Banjo Kazooie in the late 90s
It goes back even farther than that, in the context of bots, the 1950s. And the word itself goes back to the 18th century when it meant a lie.
It doesn't shock me that people on the internet have found a way to turn it into a bigger deal though. If someone isn't offended, what's even the point?
But even in the Star Wars context, it's clearly meant to stand in for other dehumanizing terms that soldiers at war have used for racialized enemies. And Star Wars depicts the word as being used in a world where droids, to the camera, are people. Often people (like our famous C3-PO and R2-D2) working support for those people who are using the word to describe droids on the other side.
So it's not a great word for what the author is trying to do, in my opinion: it's already coming in with these metaphors attached.
Was it used pejoratively in that game? I ask because "clanker" in the Star Wars media that I've seen that uses it seems to use it disparagingly or derisively. At least that's my understanding of the term in that milieu.
It was, definitely. My point isn't that it's not pejorative, my point was that it was not created recently as an analogue to the N-word.
@pendingketchup for the same response.
Oh, I wasn't suggesting anything else. I just wanted to know the flavor and tone of it. Usually word's earliest introduction has a great deal of influence on its later adoption.
If anything I would say it sounds closest to "wanker".
Yeah look, sometimes other people ruin things for you... You can still say the thing but then you're associated with the shitty people using the term to covertly be racist for real.
(Also if we end up with future machine people I can think of a bunch more things that'll be a problem before language.)
One reason I dislike "clanker" is that it doesn't work as a metaphor. "Clanker" implies a machine that makes a lot of noise. Chatbots are silent. They're also invisible unless you go online. "Bot" seems straightfoward, but I also like "ghost."
If you filter by pages in Category:English derogatory terms and Category:en:Artificial intelligence you will probably find more.
I dislike "clanker" because I mostly see it being used as a slur, and I don't need special words or pejoratives for LLM Agents, because they're nothing special. Just like I don't have a special word for the printer that refuses to let me print anything, or any other piece of tech that doesn't function exactly as I think it should. What are we going to do next, invent a slur for the fridge with advertising on its front panel? How about smart TVs that refuse to work without an internet connection? Shall we call the TVankers? Miss me with that.
Work in tech support for a couple of weeks and get back to me with your findings.
I do work in tech-support, actually. But I’ve been doing it for over 20 years, so I’m not as bothered about the whole thing. Not to say I don’t have my complaints and I don’t have my various nemesis, but I generally find that their proper names are epithet enough. Say anything with enough bile and it becomes a curse word.
Ah I apologize. Don't take my post as any more than the joke about printers being periodically unworkable hate machines.
No worries! I didn't take offense in any way at that. I should've been more clear when I was mentioning "my various nemesis" because printers? On the list, top of the list, day one, on sight if I ever meet the chaps that invented the modern ones.
Especially home inkjet printers are the worst thing we ever invented. Same complaint as always: why can I print black and white if my magenta cartridge is low? What did you do to my magenta cartridge, I've never printed color in my life.
My Canon laser printer has been a trooper for years. I rarely print anything so I'm still on my first cartridge after almost a decade. But when I tell you it took me literally 5 years to figure out how to print over the network because I misconfigured it the first time and it took years of effort and me finally sitting down one night with the poorly-translated manual and a full 2-liter of caffeinated soda to fix it...
Now it works great, just update to the latest drivers now and again, hey presto you printed over the network! EZ PZ. But the effort it took to get there? Never again.
I'm very into this, actually.
(Jokes aside, I agree that the whole thing is a bit silly. I also do not use weird pejorative terms for AI agents, unless they're being fucking stupid, in which case I call them "fucking idiots").
I curse the programmers and whichever petaQ unleashed this spoiled gagh onto unsuspecting innocents, then I do glorious battle with it. But I am secretly a Klingon.
I think the author's immediate dismissal of a concept of "model welfare" as harmful is wrong.
A language model, even a fancy one with "tool use" and "memory", is not a person. But it's also something like a fictional character (since ultimately one ends up with an extremely long and boring fanfic about "User" and "Assistant"), and it is something like a fragment of a mind (something which one could imagine as forming part of a constructed person, or being made into a neural prosthetic for the treatment of aphasia, stuck in among an otherwise human brain).
Is it possible to harm a fictional character? Is it possible to act somehow in relation to a fictional character that does not harm them but is wrong anyway? Does it matter if we are dealing not with an original character, but with someone's idea of another human? I guarantee you that it is possible for someone to write something that, if you read it, you will not be happy to live on the same planet as them, because of what their having written it reveals about their soul. Is it possible to construct such a piece of writing without wronging, in some sense, its characters?
Or, imagine a very good language model. Imagine it is very good at predicting what your loved one might say in any given situation. It's the year 20XX, everyone plays frame-perfect Fox, and this model has been trained on everything that has ever happened within 50 feet of a device running Google Play Services. It can predict what your loved one might say and do with such accuracy that you are no better than chance at sorting text descriptions of real conversations with or events involving them from outputs of the model, for lengths up to 500 words.
Imagine that someone sets it to generating thousands and thousands of unique descriptions of your loved one being subjected to horrible situations, each exactly 498 words long. You don't even need to read them: the descriptions of exactly what they would say upon realizing they were condemned to each of these fates worse than death go directly to
/dev/null, or perhaps are hashed and stored in a database just to prove that they happened. But you know they're there. Each time one is completed, the machine emits a soft "ding".The model as such is, of course, fine. Nothing bad has happened to GoogleBook TurboLlama 5000; it's weights are all the same. Your loved one is safely uninjured in the next room. Neither of you has to hear the dinging: you can just walk away.
Anyone who does not destroy that machine is a monster.
Now cast "Assistant" as your loved one. Is it any better because the character is now an amalgamation of every helpful writer on the Internet, instead of an interpretation of a single person? Was the harm somehow coursing down the referential relationship to settle on the natural person in a way undetectable to them?
Does this mean ChatGPT deserves the vote? That doesn't sound plausible. But to be so confident that it is not possible to do harm to something like a fragment of a person, using something like a fragment of a mind, that one makes the assertion that thinking on it is "actively harmful", smacks of hubris.
Having grown up in the age of the Matrix and James Bond in popular culture, I personally don't associate "Agent" with a human, but a function first and foremost. James Bond isn't a secret agent when he's relaxing in Monaco, and Agent Smith literally was an AI.
It's interesting to me that so many here feel that 'clanker' is a slur. English is second language for me, and when I recently heard the expression the first time, I thought it sounded like a - maybe even somewhat affectionate - term for retrofuturistic robots, which was now used for LLMs.
I never used the word myself, but I would never have guessed that it has these very negative connotations and is even associated with racial slurs.
Regarding politeness when dealing with LLMs: I wonder if there are certain biases that are triggered by the way people communicate with LLMs.
Since humans typically react to rudeness with some kind of resistance in the form of being uncooperative, and since these models were trained on hundreds of thousands of texts in which humans reacted negatively to rudeness or even oppression, I wonder if these emotional reactions find their way as hidden biases into the weights of LLMs during training.
Especially if an LLM is then instructed to act as a personal assistant - to mimic a human being - I could imagine that these biases get triggered when being 'mistreated', and as a result the model basically 'cosplays' some form of human opposition by being less helpful. Like another form of what Anthropic calls agentic misalignment.