this post was submitted on 13 Aug 2023
343 points (74.6% liked)

Technology

59664 readers
2639 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Death_Equity@lemmy.world 65 points 1 year ago (4 children)

Wait, has anybody bothered to ask AI how to fix itself? How much Avocado testing does it do? Can AI pull itself up by its own boot partition, or does it expect the administrator to just give it everything?

[–] wizardbeard@lemmy.dbzer0.com 12 points 1 year ago (1 children)

Really says something that none of your responses yet seem to have caught that this was a joke.

[–] Death_Equity@lemmy.world 3 points 1 year ago

The upvotes vs comments shows the vocal minority is just doing vocal minority things.

[–] vrighter@discuss.tchncs.de 5 points 1 year ago

if we don't know, it doesn't know.

If we know, but there's no public text about it, it doesn't know either.

it is trained off of stuff that has already been written, and trained to emulate the statistical properties of those words. It cannot and will not tell us anything new

[–] Buffaloaf@lemmy.world 4 points 1 year ago (2 children)

I asked Bard how ChatGPT can fix itself, here's what it said:

ChatGPT can fix itself in a number of ways, including:

Retraining on a larger dataset. ChatGPT is trained on a massive dataset of text and code, but it can always be retrained on a larger dataset. This would help ChatGPT to learn new things and improve its performance.

Using a different algorithm. ChatGPT is currently trained using the GPT-3 algorithm, but there are other algorithms that could be used. For example, ChatGPT could be trained using the Megatron-Turing NLG algorithm, which is one of the most powerful language models in the world.

Using a combination of algorithms. ChatGPT could also be trained using a combination of algorithms. This would allow ChatGPT to benefit from the strengths of different algorithms.

Using a feedback loop. ChatGPT could be used to generate text, and then this text could be used to train ChatGPT. This would allow ChatGPT to learn from its own mistakes and improve its performance over time.

Using human feedback. ChatGPT could also be used to generate text, and then this text could be reviewed by humans. The human feedback could then be used to improve ChatGPT's performance.

[–] lagomorphlecture@lemm.ee 10 points 1 year ago (1 children)

"Using a feedback loop. ChatGPT could be used to generate text, and then this text could be used to train ChatGPT. This would allow ChatGPT to learn from its own mistakes and improve its performance over time."

So basically create its own Fox News and see how that goes.

[–] vrighter@discuss.tchncs.de 11 points 1 year ago (1 children)

this is widely known to very quickly destroy your model

[–] Buffaloaf@lemmy.world 4 points 1 year ago

Remember, this is Bard's advice for ChatGPT

[–] chaogomu@kbin.social 7 points 1 year ago

The feedback loop is already happening, and is called model collapse.

It's not a good thing.

[–] Zeth0s@lemmy.world 1 points 1 year ago

It's working on it. It's just a pretty difficult task to be better than 50 years of optimization by human computer scientists https://www.nature.com/articles/d41586-023-01883-4