this post was submitted on 09 Aug 2026
80 points (90.0% liked)

Technology

87162 readers
3985 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 30 comments
sorted by: hot top controversial new old
[–] eicker@lemmy.world 42 points 5 days ago (3 children)

Auto mode sounds less like security and more like outsourcing judgment to the same AI you’re supposedly trying to constrain. If users are bad at spotting malicious prompts, the answer shouldn’t be: great, let’s remove them from the loop entirely. That’s not safety. That’s automated permission laundering.

[–] Zarobi@aussie.zone 41 points 5 days ago (2 children)

That’s not safety. That’s automated permission laundering.

*Twitches*

[–] volore@scribe.disroot.org 16 points 5 days ago

Oh good, it wasn't just me.

[–] WhyJiffie@sh.itjust.works 1 points 4 days ago (1 children)

I'm not sure I get it, do you mean it looks like how claude writes?

[–] Zarobi@aussie.zone 4 points 4 days ago (1 children)

Yeah, A.I. often writes like "it's not x, it's y"

[–] WhyJiffie@sh.itjust.works 2 points 3 days ago (1 children)

especially when separated by dot instead of a comma

[–] Zarobi@aussie.zone 0 points 3 days ago (1 children)
[–] dabster291@lemmy.zip 2 points 2 days ago

"It's not x. It's y." instead of "It's not x, it's y."

[–] anomnom@sh.itjust.works 11 points 5 days ago

I just assumed it was to increase token use and create a windfall for Anthropic

[–] Armand1@lemmy.world 12 points 5 days ago* (last edited 5 days ago) (1 children)

So if I remember correctly, what happens with auto mode is they run a second smaller LLM called the "classifier" to evaluate the tool uses of the main one.

I've used auto mode at work now for many months, and it approves most things because most things Claude does are reasonable.

Once or twice I have seen it reject Claude. I can't remember the exact scenario, but I had asked Claude to diagnose an issue but not fix it yet, and when later on it tried to make the change the classifier rejected it, giving the reason that what it was trying to do did not match my request.

In my opinion, the trick to using auto mode safely here is to:

  • Commit and push your changes before handing over the reins (it rarely commits or pushes without you telling it to, especially if you have never asked in that session).
  • Don't give it access to things it shouldn't have access to or that can do significant damage
  • Don't give ambiguous prompts.
  • Never use LLMs against untrusted code or files, as it may contain prompt injections.
[–] dgriffith@aussie.zone 11 points 5 days ago (2 children)

I had Claude with auto-permission on accidentally delete an Open3D build folder in its workspace today while updating an old project to the bleeding edge out of github. I had the older release in, "open3d" and "open3d-debug", so it cleverly used "open3d*" to tidy both folders up, so that the latest version, in the folder, "Open3D-main", would be used from now on.

Except guess what? The windows box it was running on treats filenames as case-insensitive, and all folders matching open3d got nuked.

* sad trombone noises *

Cue grovelling apology from Claude offering to re-download and build Open3D again, a process that takes a couple of hours on my PC. Interestingly, it only noticed a few more steps further down the road, not immediately.

Luckily it was working in a sandbox copied from the real repository, so I just copied it back. But I really do have to get my act together and run things in proper isolation. Everything is backed up elsewhere on this build PC, but it would be a hassle if it got wrecked.

[–] mobyduck648@lemmy.world 3 points 4 days ago* (last edited 4 days ago)

My favourite claudism is when it deletes tens of gigabytes sized models as if redownloading them is trivial for me. It might be for the boys at Anthropic with their sewer pipe sized fibre optics, but for me where my last mile is copper bullshit Openreach probably hasn't maintained since the 2008 crash it's a massive pain in the arse.

[–] Supercrunchy@programming.dev 5 points 5 days ago

Yes I never trusted it fully, and I would strongly suggest anyone to run it in a VM or at least a container, where it doesn't have access to your credentials, browser cookies and sensitive files. It's very irresponsible otherwise.

Example: around 1 year ago the bot made a small coding mistake and created a '~' folder. I asked it to delete it (not in auto mode) and of course it went with a very nice "rm -rf ~" (which of course I denied).

Modern models are much smarter, but I would not trust the auto classifier to stop everything dangerous and make a similar hallucination slip through.

[–] elgordino@fedia.io 25 points 5 days ago (1 children)

I like auto mode but you need something like “If the auto mode classifier denies your request stop and ask the human, do not attempt to work around it “ in your CLAUDE.md. Without it it has a tendency to try rather creative solutions to work around the denial, which kind of misses the point.

[–] okwhateverdude@lemmy.world 17 points 5 days ago

My denials always have a reason like "FUCK YOU I already told you not to do that dumb shit! NO EDITS WITH SED" which tends to keep it in check.

Anthropic is batshit crazy if they think automode is ready for default-on-always when their clankers constantly fuck up. Did they survey the dumbest 1100 people that don't check the output carefully? The numbers in this article do NOT inspire confidence.

[–] chronicledmonocle@lemmy.world 16 points 5 days ago (2 children)

If a pilot of a plane told me that they catch any critical errors they make 89% of the time, I would NOT get on that fucking plane.

[–] xiii@lemmy.world 1 points 4 days ago

Anthropic or not, the recent streak of supply chain and also targeted attacks got me packing into VM.

Now I run all devtools and install packages only inside the VM and either connect Zed / VSCode via ssh or run terminal ide inside the VM.

No host mounts whatsoever, all communication Host to Guest strictly through git.

[–] Corkyskog@sh.itjust.works 0 points 5 days ago (2 children)

Yeah but if I were buying cheap corn and they said 89% of the ears were good, I would still buy the corn. So is AI airplanes or corn?

[–] chronicledmonocle@lemmy.world 12 points 4 days ago* (last edited 4 days ago)

That's not entirely the same thing. It says it catches 89% of HARMFUL actions. That means that 11% of the time it doesn't.

That's more like if the corn had a parasite on it that could give you explosive diarrhea 11% of the time. Would you still eat the corn?

Also, in my example, I didn't say the harmful actions of the pilot resulted in a crash. However, that doesn't mean it couldn't. How many of those 11% of the time are the "woops I deleted the production database" stories we hear all the time?

[–] partofthevoice@lemmy.zip 1 points 5 days ago

But if I was buying a bottle of water and they said 11% of the water might be contaminated, I’m not buying it. Same for corn, actually. In fact, if they know only 11% of the ears are bad, they should be able to tell me how they’re bad. If they can’t, then they really mean “untested” and that’s a no go from me.

[–] Scipitie@lemmy.dbzer0.com 16 points 5 days ago

The issue is the whole UX behind it. I have yet to see someone review the 30th prompt of "grep" - there is no same default or middle ground.

For example whitelist read actions or harness side limitations to the project folder.

This is just lazy - again. "Users don't use or very bad security feature so they just want us to disable it".

[–] magnue@lemmy.world 7 points 5 days ago (1 children)

Honestly I've been using auto for the past year and it hasn't bitten me once. It generally still pauses if there's a big decision to be made, and small decisions that were made are shown.

[–] Avicenna@programming.dev 4 points 5 days ago* (last edited 5 days ago)

yeah same here, the worst it can do is get in some weird loops to resolve an issue which can normally be resolved by better prompting or pointing it in the correct direction. But it is pretty good with file handling and usage of temp folder. I usually let it do auto but ask it not to implement anything before having a discussion with me so it generally does stuff in scratchpads in temp. One thing annoying about Claude is though when you open the session in a folder to work on a small script it generally goes as "ok let me read everything recursively staring from four parents up to get the context." Probably can be handled with better config files but I just generally handle couple of initial request manually and then once it is in analysis mode I let it go auto

[–] fubarx@lemmy.world 7 points 5 days ago

The OpenAI talk at DefCon shows what can happen when you let these things run without any human intervention.

The solution is, obviously, even less human intervention. 🤦🏻‍♂️

[–] Blackmist@feddit.uk 5 points 5 days ago (1 children)

I just say yes to everything anyway. Not my money, not my choice to use it, not my responsibility. You give me a machine gun, I ain't firing single rounds.

[–] dhtseany@lemmy.ml 2 points 5 days ago

That's called vibe coding.

[–] fargeol@lemmy.world 4 points 5 days ago

"Claude is better than humans to detect errors Claude makes, therefore, you will use Claude"

[–] BeatTakeshi@lemmy.world 4 points 5 days ago

A brand new FAFO machine, great!

[–] LedgeDrop@lemmy.zip 3 points 5 days ago (1 children)

Hooray, uncontrolled and unregulated consumption of tokens. What could go wrong? /s

[–] UltraBlack@lemmy.world 1 points 5 days ago

Anthropic will thrive