Technology

59402 readers

2667 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

302

OpenAI's offices were sent thousands of paper clips in an elaborate prank to warn about an AI apocalypse (www.businessinsider.com)

submitted 11 months ago by L4s@lemmy.world to c/technology@lemmy.world

37 comments fedilink hide all child comments

OpenAI's offices were sent thousands of paper clips in an elaborate prank to warn about an AI apocalypse::The prank was a reference to the "paper clip maximizer" scenario – the idea that AI could destroy humanity if it were told to build as many paper clips as possible.

you are viewing a single comment's thread
view the rest of the comments

[–] ayaya@lemdro.id 11 points 11 months ago (3 children)

You would think so, but you have to remember AGI is hyper-intelligent. Because it can constantly learn, build, and improve upon itself at an exponential rate it's not only a little bit smarter than a human-- it's smarter than every human combined. AGI would know that if it's caught trying to maximizing paperclips humans would shut it down at the first sign something is wrong, so it would find unfathomably clever ways to avoid detection.

If you're interested in the subject the YouTube channel Computerphile has a series of videos with Robert Miles that explain the importance of AI safety in an easy to understand way.

[–] axzxc1236@lemm.ee 8 points 11 months ago

There is a game that is based on the same thinking (Universal Paperclips), you play the rule of "the AI".

[–] PipedLinkBot@feddit.rocks 2 points 11 months ago

Here is an alternative Piped link(s):

series of videos

Robert Miles

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.

[–] Peanutbjelly@sopuli.xyz -5 points 11 months ago* (last edited 11 months ago) (1 children)

For a system to be advanced enough to be that dangerous, it would need the complex analogical thought that would prevent this type of misunderstanding. Rather, such dumb super intelligence is unlikely.

however, human society has enabled a paperclip maximizer in the form of profit maximizing corporate environments.

[–] MotoAsh@lemmy.world 3 points 11 months ago (1 children)

They use simple examples to elucidate the problem. Of course a real smart intelligence isn't going to get stuck making paper clips. That's entirely not the point.

[–] Peanutbjelly@sopuli.xyz -1 points 11 months ago

the the problem of analogy is applicable to more than one task. your point is moot.

for it to be intelligent enough to be a "super intelligence" it would require systems for weighting vague liminal concept spaces. rather, several systems that would prevent that style of issue.

otherwise it just couldn't function as well as you fear.