this post was submitted on 22 Jun 2025
783 points (94.3% liked)

Technology

74473 readers
4486 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.

Then retrain on that.

Far too much garbage in any foundation model trained on uncorrected data.

Source.

More Context

Source.

Source.

you are viewing a single comment's thread
view the rest of the comments
[–] maxfield@pf.z.org 162 points 2 months ago (5 children)

The plan to "rewrite the entire corpus of human knowledge" with AI sounds impressive until you realize LLMs are just pattern-matching systems that remix existing text. They can't create genuinely new knowledge or identify "missing information" that wasn't already in their training data.

What he means is correct the model so all it models is racism and far-right nonsense.

[–] SinningStromgald@lemmy.world 88 points 2 months ago (1 children)

Remember the "white genocide in South Africa" nonsense? That kind of rewriting of history.

[–] BrokenGlepnir@lemmy.world 6 points 2 months ago (3 children)

It's not the LLM doing that though. It's the people feeding it information

[–] MajinBlayze@lemmy.world 24 points 2 months ago* (last edited 2 months ago)

Try rereading the whole tweet, it's not very long. It's specifically saying that they plan to "correct" the dataset using Grok, then retrain with that dataset.

It would be way too expensive to go through it by hand

[–] SaltySalamander@fedia.io 8 points 2 months ago

Literally what Elon is talking about doing...

[–] zqps@sh.itjust.works 8 points 2 months ago

Yes.

He wants to prompt grok to rewrite history according to his worldview, then retrain the model on that output.

[–] eecobb@lemmy.sdf.org 8 points 2 months ago (1 children)

But Grok 3.5/4 has Advanced Reasoning

[–] const_void@lemmy.ml 15 points 2 months ago (1 children)

Surprised he didn’t name it Giga Reasoning or some other dumb shit.

[–] Archer@lemmy.world 4 points 2 months ago

Gigachad Reasoning

[–] WizardofFrobozz@lemmy.ca 0 points 2 months ago (1 children)

To be fair, your brain is a pattern-matching system.

When you catch a ball, you’re not doing the physics calculations in your head- you’re making predictions based on an enormous quantity of input. Unless you’re being very deliberate, you’re not thinking before you speak every word- your brain’s predictive processing takes over and you often literally speak before you think.

Fuck LLMs- but I think it’s a bit wild to dismiss the power of a sufficiently advanced pattern-matching system.

[–] zildjiandrummer1@lemmy.world 1 points 2 months ago

I said literally this in my reply, and the lemmy hivemind downvoted me. Beware of sharing information here I guess.