this post was submitted on 26 Jul 2024
236 points (96.1% liked)

Technology

59377 readers
2543 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Alphane_Moon@lemmy.world 6 points 3 months ago* (last edited 3 months ago) (1 children)

Thanks for the reply.

I guess we'll see what happens.

I still find it difficult to get my head around how a decrease in novel training data will not eventually cause problems (even with techniques to work around this in the short term, which I am sure work well on a relative basis).

A bit of an aside, I also have zero trust in the people behind current LLM, both the leadership (e.g. Altman) or the rank and file. If it's in their interests do downplay the scope and impact of model degeneracy, they will not hesitate to lie about it.

[–] Warl0k3@lemmy.world 2 points 3 months ago* (last edited 3 months ago) (1 children)

Yikes. Well. I'll be over here, conspiring with the other NASA lizard people on how best to deceive you by politely answering questions on a site where maaaaybe 20 total people will actually read it. Good luck getting your head around it, there's lots of papers out there that might help (well, assuming I'm not lying to you about those, too).

[–] Alphane_Moon@lemmy.world 1 points 3 months ago

This was a general comment, not aimed at you. Honestly, it wasn't my intention to accuse you specifically. Apologies for that.