this post was submitted on 23 Mar 2025
772 points (97.8% liked)

Technology

67669 readers
5714 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
772
Dad demands OpenAI delete ChatGPT’s false claim that he murdered his kids (arstechnica.com)
submitted 5 days ago by OpenPassageways@lemmy.zip to c/technology@lemmy.world
141 comments fedilink hide all child comments
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] FiskFisk33@startrek.website -1 points 5 days ago* (last edited 5 days ago) (1 children)

It's not unreadable, it doesn't exist.

Then what do you mean trained AI models are?

The ai model is trained on data and encodes unknown parts of that data in its weights.

This is data storage. Unmanageable, almost unknowable data storage, but still data storage.

If it didn't store data it couldn't learn from its training.

[–] DoPeopleLookHere@sh.itjust.works 11 points 5 days ago (1 children)

Your still placing more intent and facts into those processes than actually exist.

You cant even get it to count how many letter p are in the word apple. At least not last time I tried.

That storage your talking about isn't facts. It's how sentences are structured and what they "mean".

As for the output "meaning" it's still just guessing what you want to hear. No facts involved.

[–] FiskFisk33@startrek.website -1 points 5 days ago (1 children)

Your still placing more intent and facts into those processes than actually exist.

No? When they train AI's on data they lose control of that data. If the data is sensitive, they aren't being responsible.

GPT models are as you say dumb statistical models, I agree. But in its weights are encoded ghost images of its training data. The model being dumb is not sufficient to make the data storing itself defensible in my opinion.

[–] DoPeopleLookHere@sh.itjust.works 6 points 5 days ago (1 children)

Sure, but are you suggesting they somehow encoded, falsely, that they were a murder?

Because it's very unlikely.

It fabricated this from no where. So there's nothing to delete. Because it's just a response to a prompt.

[–] FiskFisk33@startrek.website -2 points 5 days ago* (last edited 5 days ago) (1 children)

No I'm not, that part is absolutely hallucinated. Where the problem comes in is that it then output correct personal information about him and his children. A to me clear violation of GDPR.

but it also mixed "clearly identifiable personal data"—such as the actual number and gender of Holmen's children and the name of his hometown—with the "fake information,"

[–] DoPeopleLookHere@sh.itjust.works 2 points 4 days ago

That's not what they're asking for. They're asking for the ability for it to not generate that sentence again.