this post was submitted on 08 Aug 2025
760 points (96.6% liked)

Technology

73833 readers
4435 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Or my favorite quote from the article

"I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write... code on the walls with my own feces," it said.

you are viewing a single comment's thread
view the rest of the comments
[–] btaf45@lemmy.world -1 points 1 day ago* (last edited 1 day ago) (11 children)

[ "I am a disgrace to my profession," Gemini continued. "I am a disgrace to my family. I am a disgrace to my species.]

This should tell us that AI thinks as a human because it is trained on human words and doesn't have the self awareness to understand it is different from humans. So it is going to sound very much like a human even though it is not human. It mimics human emotions well but doesn't have any actual human emotions. There will be situations where you can tell the difference. Some situations that would make an actual human angry or guilty or something, but won't always provoke this mimicry in an AI. Because when humans feel emotions they don't always write down words to show it. And AI only knows what humans write, which is not always the same things that humans say or think. We all know that the AI doesn't have a family and is not a human species. But the AI talks about having a family because its computer database is mimicking what it thinks a human might say. And part of the reason why an AI will lie is because it knows that is a thing that humans do and it is trying to closely mimic human behavior. But an AI might and will lie in situations where humans would be smart enough not to do so which means we should be on our guard about lies even more so for AIs than humans.

[–] ganryuu@lemmy.ca 15 points 1 day ago (1 children)

You're giving way too much credit to LLMs. AIs don't "know" things, like "humans lie". They are basically like a very complex autocomplete backed by a huge amount of computing power. They cannot "lie" because they do not even understand what it is they are writing.

[–] btaf45@lemmy.world 4 points 1 day ago (2 children)

Can you explain why AIs always have a "confidently incorrect" stance instead of admitting they don't know the answer to something?

[–] ganryuu@lemmy.ca 2 points 23 hours ago* (last edited 22 hours ago) (1 children)

I'd say that it's simply because most people on the internet (the dataset the LLMs are trained on) say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not. So AIs will talk confidently because most people do so. It could also be something about how they are configured.

Again, they don't know if they know the answer, they just say what's the most statistically probable thing to say given your message and their prompt.

[–] btaf45@lemmy.world 1 points 22 hours ago* (last edited 22 hours ago) (1 children)

Again, they don’t know if they know the answer

Then in that respect AIs aren't even as powerful as an ordinary computer program.

say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not.

That was my guess too.

[–] Aggravationstation@feddit.uk 1 points 13 hours ago (1 children)

Then in that respect AIs aren't even as powerful as an ordinary computer program.

No computer programs "know" anything. They're just sets of instructions with varying complexity.

[–] btaf45@lemmy.world 1 points 9 hours ago* (last edited 9 hours ago) (1 children)

No computer programs “know” anything.

Can you stop with the nonsense? LMFAO...

if exists(thing) {
write(thing);
} else {
write("I do not know");
}

[–] Aggravationstation@feddit.uk 1 points 8 hours ago* (last edited 8 hours ago)

if exists(thing) {
write(thing);
} else {
write("I do not know");
}

Yea I see what you mean, I guess in that sense they know if a state is true or false.

[–] Matty_r@programming.dev 2 points 1 day ago (1 children)

Because its an auto complete trained on typical responses to things. It doesn't know right from wrong, just the next word based on a statistical likelihood.

[–] btaf45@lemmy.world 1 points 22 hours ago (1 children)

Are you saying the AI does not know when it does not know something?

[–] Matty_r@programming.dev 1 points 19 hours ago* (last edited 19 hours ago)

Exactly. I'm over simplifying it of course, but that's generally how it works. Its also not "AI" as in Artificial Intelligence, in the traditional sense of the word, its Machine Learning. But of course its effectively had a semantic change over the last couple years because AI sounds cooler.

Edit: just wanted to clarifying I'm talking about LLMs like ChatGPT etc

load more comments (9 replies)