this post was submitted on 14 Sep 2026
1061 points (98.1% liked)
Technology
88041 readers
4488 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Except LLMs haven't show themselves capable of that at all, they have no agency, they just generate output based on their input Ina somewhat chaotic manner.
Tools have been built that basically chain LLM output into input and given some starting directions get the LLM to generate commands that can be ran on the local machine including commands to run commands on other machines. Because various conversations on exploits and hacking and sample code are in its training corpus it will generate commands to do these things. Not because the LLM or the agent program is smart in anyway but I fact because it's dumb as bricks and has no concept of what it's doing or the consequences might be.
Ultimately a human has used it as a tool to achieve the hacking. It's might not be the intended achievement but that is on the human running a process with chaotic output with sufficient privileges with no oversight.
It's hard to take this type of response seriously as it simply ignores objective reality. The claim of a human being required to start the process is utterly meaningless to the point. Sure though, I'll throw you a bone: if no human ever initiates the task it simply won't happen. Can we move on now since humans are happily initiating the actions?
I couldn't care less what people think about whether or not they are "thinking" or "having agency of their own"[1]. I care about the practical reality of the world in which LLMs have shown, and will continue to show, the ability to exploit computer systems and humans. You can toss your head in the sand and think you have some sort of weird pseudo-intellectual high ground by claiming "but akchtually it's just a result of their training data". Like, yea, dawg, that's how this works, congrats. Of course the thing that is trained on training data is trained on training data.
[1] At least when discussing their capabilities. When someone is willing to have that discussion beyond the tired "they're just autocomplete!" trivialization it's interesting.