this post was submitted on 14 Mar 2026
642 points (98.6% liked)
Technology
82713 readers
3873 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not only will it have a lot of notes, every time you ask if to analyze the code it will find new notes. Real engineers are telling me this is a good code review tool but it can't even find the same issues reliably. I don't understand how adding a bunch of non-deterministic tooling is supposed to make my code better.
Though on that note, I don't think having an LLM review your code is useless, but if it's code that you care about, read the response and think about it to see if you agree. Sometimes it has useful pointers, sometimes it is full of shit.
So when do I stop asking the LLM to take another look? If it finds a new issue on the second or third or fourth check am I supposed to just sit here and keep asking it to "pretty please take another look and don't miss anything this time"?
I'm not saying it's a useless tool, it's just not a replacement for a human code review at all.
Stop when you feel like it, just like any other verification method. You don't really prove that there are no problems with software development, it's more of a "try to think of any problem you can and do your best to make sure it doesn't have any of those problems" plus "just run it a lot and fix any problems that come up".
An LLM is just another approach to finding potential problems. And it will eventually say everything looks good, though not because everything is good but because that happens in its training data and eventually that will become the best correlated tokens (assuming it doesn't get stuck flipping between two or more sides of a debated issue).
That sounds worse than useless. It would be better to fail utterly than make up shit that you have to waste time parsing through.
It helps in the sense of once you've looked at code enough times, you can stop really seeing it. So many times I've debugged issues where I looked many times at an error that is obvious in hindsight but I just couldn't see it before that. And that's in cases where I knew there was an issue somewhere in the code.
Or for optimization advice, if you have a good idea of how efficiency works, it's usually not difficult to filter the ideas it gives you into "worthwhile", "worth investigating", "probably won't help anything", and "will make things worse".
It's like a brainstorming buddy. And just like with your own ideas, you need to evaluate them or at least remember to test to see if it actually does work better than what was there before.