this post was submitted on 13 Mar 2024
605 points (95.1% liked)

Technology

59323 readers
4651 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
L3s@fry.gs
L4s@fry.gs
L4s@lemmy.world
enu@lemmy.world
605
Amazon's Hidden Chatbot Recommends Nazi Books and Lies About Amazon Working Conditions (www.404media.co)
submitted 8 months ago by Stopthatgirl7@lemmy.world to c/technology@lemmy.world
79 comments fedilink hide all child comments
 

An Amazon chatbot that’s supposed to surface useful information from customer reviews of specific products will also recommend a variety of racist books, lie about working conditions at Amazon, and write a cover letter for a job application with entirely made up work experience when asked, 404 Media has found.

you are viewing a single comment's thread
view the rest of the comments
[–] helpImTrappedOnline@lemmy.world 26 points 8 months ago (4 children)

Can we please stop with these stories about "AI chatbot has grabage output"? We know that. Let me know when they work.

[–] Murdoc@sh.itjust.works 5 points 8 months ago

Just because you know that doesn't mean that everybody does, and it's an important thing to know.

[–] HereIAm@lemmy.world 2 points 8 months ago

I don't see these stories as about what the chat ai outputs, but more about questioning whether or not amazon should be held liable for what their AI outputs. Traditional customer support chatbots are often less than useless, but they wouldn't go about suggesting the product they're selling are defective or recommending offensive products. I'm of the opinion that Amazon's review search AI thing should be held up to the same standard that a human would be. And if a person started acting like this they would surely be quickly fired.

They are a black box, and for now trying to restrain the black box has sever impact on the usefulness of the output even in easier and legit situations.

[–] brbposting@sh.itjust.works 1 points 8 months ago (1 children)

Claude 3 Opus will rewrite stuff for you real good. Pit it against GPT-4-Turbo at LMSys’s arena.

Rewriting. Brainstorming. Expanding notes into drafts. For some, coding.

Want to learn something new without having to re-verify it? Yeah that’ll have to wait :)

[–] merc@sh.itjust.works 6 points 8 months ago (1 children)

rewrite stuff for you real good

I guess this is one way of proving you're not a chatbot...

[–] Kinglink@lemmy.world -3 points 8 months ago

They work about 75 to 90 percent of the time... You don't really want to hear stories about that either.

Both sides of LLM stories are just clickbait.