this post was submitted on 11 Sep 2023
92 points (68.3% liked)

Technology

59135 readers
2878 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] theluddite@lemmy.ml 11 points 1 year ago (2 children)

"I gave an LLM a wildly oversimplified version of a complex human task and it did pretty well"

For how long will we be forced to endure different versions of the same article?

The study said 86.66% of the generated software systems were "executed flawlessly."

Like I said yesterday, in a post celebrating how ChatGPT can do medical questions with less than 80% accuracy, that is trash. A company with absolute shit code still has virtually all of it "execute flawlessly." Whether or not code executes it not the bar by which we judge it.

Even if it were to hit 100%, which it does not, there's so much more to making things than this obviously oversimplified simulation of a tech company. Real engineering involves getting people in a room, managing stakeholders, navigating conflicting desires from different stakeholders, getting to know the human beings who need a problem solved, and so on.

LLMs are not capable of this kind of meaningful collaboration, despite all this hype.

[–] Lucidlethargy@sh.itjust.works 2 points 1 year ago* (last edited 1 year ago)

So what you're saying is that 86.66% of the time, it works every time.

[–] PlexSheep@feddit.de 1 points 1 year ago* (last edited 1 year ago) (1 children)

Thank you for writing this so I only have to ~~upvore~~ upvote you.

Edit: What the difference between one key can be

[–] nul@programming.dev 2 points 1 year ago

I don't know what an upvore is and I don't want to know.