this post was submitted on 13 Aug 2023
342 points (74.5% liked)

Technology

73450 readers
4734 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Billy_Gnosis@lemmy.world 45 points 2 years ago (2 children)

If AI was so great, it would find a solution to operate at fraction of the cost it does now

[–] Death_Equity@lemmy.world 65 points 2 years ago (4 children)

Wait, has anybody bothered to ask AI how to fix itself? How much Avocado testing does it do? Can AI pull itself up by its own boot partition, or does it expect the administrator to just give it everything?

[–] wizardbeard@lemmy.dbzer0.com 12 points 2 years ago (1 children)

Really says something that none of your responses yet seem to have caught that this was a joke.

[–] Death_Equity@lemmy.world 3 points 2 years ago

The upvotes vs comments shows the vocal minority is just doing vocal minority things.

[–] vrighter@discuss.tchncs.de 5 points 2 years ago

if we don't know, it doesn't know.

If we know, but there's no public text about it, it doesn't know either.

it is trained off of stuff that has already been written, and trained to emulate the statistical properties of those words. It cannot and will not tell us anything new

[–] Buffaloaf@lemmy.world 4 points 2 years ago (2 children)

I asked Bard how ChatGPT can fix itself, here's what it said:

ChatGPT can fix itself in a number of ways, including:

Retraining on a larger dataset. ChatGPT is trained on a massive dataset of text and code, but it can always be retrained on a larger dataset. This would help ChatGPT to learn new things and improve its performance.

Using a different algorithm. ChatGPT is currently trained using the GPT-3 algorithm, but there are other algorithms that could be used. For example, ChatGPT could be trained using the Megatron-Turing NLG algorithm, which is one of the most powerful language models in the world.

Using a combination of algorithms. ChatGPT could also be trained using a combination of algorithms. This would allow ChatGPT to benefit from the strengths of different algorithms.

Using a feedback loop. ChatGPT could be used to generate text, and then this text could be used to train ChatGPT. This would allow ChatGPT to learn from its own mistakes and improve its performance over time.

Using human feedback. ChatGPT could also be used to generate text, and then this text could be reviewed by humans. The human feedback could then be used to improve ChatGPT's performance.

[–] lagomorphlecture@lemm.ee 10 points 2 years ago (1 children)

"Using a feedback loop. ChatGPT could be used to generate text, and then this text could be used to train ChatGPT. This would allow ChatGPT to learn from its own mistakes and improve its performance over time."

So basically create its own Fox News and see how that goes.

[–] vrighter@discuss.tchncs.de 11 points 2 years ago (1 children)

this is widely known to very quickly destroy your model

[–] Buffaloaf@lemmy.world 4 points 2 years ago

Remember, this is Bard's advice for ChatGPT

[–] chaogomu@kbin.social 7 points 2 years ago

The feedback loop is already happening, and is called model collapse.

It's not a good thing.

[–] Zeth0s@lemmy.world 1 points 2 years ago

It's working on it. It's just a pretty difficult task to be better than 50 years of optimization by human computer scientists https://www.nature.com/articles/d41586-023-01883-4

[–] Zeth0s@lemmy.world 9 points 2 years ago* (last edited 2 years ago)

Deepmind is actually working on an AI that improve performances of low level programs. It started with improving sorting algorithm.

It's an RL algorithm.

Main issue is that everything takes time, and expectations on current AI are artificially inflated.

It will reach the point most are discussing now, it'll simply take a bit longer than people expect

Source: https://www.nature.com/articles/d41586-023-01883-4