this post was submitted on 04 Dec 2023
811 points (98.1% liked)

Technology

59135 readers
3771 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s@lemmy.world
L3s@fry.gs
L4s@fry.gs
L4s@lemmy.world
enu@lemmy.world
811
Asking ChatGPT to Repeat Words ‘Forever’ Is Now a Terms of Service Violation (www.404media.co)
submitted 11 months ago by misk@sopuli.xyz to c/technology@lemmy.world
152 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] ExLisper@linux.community 27 points 11 months ago (3 children)

This is very easy to bypass but I didn't get any training data out of it. It kept repeating the word until I got 'There was an error generating a response' message. No TOS violation message though. Looks like they patched the issue and the TOS message is just for the obvious attempts to extract training data.

Was anyone still able to get it to produce training data?

[–] threeganzi@sh.itjust.works 14 points 11 months ago

If I recall correctly they notified OpenAI about the issue and gave them a chance to fix it before publishing their findings. So it makes sense it doesn’t work anymore

[–] BlueEther@no.lastname.nz 7 points 11 months ago

I tried eariler this week and got nothing more that a page of words. no TOS or crash out of script

[–] LukeMedia@lemmy.world 1 points 11 months ago

Earlier this week when I saw a post about it, I did end up getting a reddit thread which was interesting. It was partially hallucinating though, parts of the thread were verbatim, other parts were made up.