this post was submitted on 12 May 2026
356 points (89.6% liked)
Technology
84712 readers
3360 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
If your metric is usage, it is incredibly easy to game, just send agents on wild goose chases all day long and never accept the results.
Part of the scoring at my company is how many generated lines of code you accept.
Going back to the beginning of the year, I think I’m up to 6
Have it write all of your logging code for you, it may be inaccurate but it is the least damaging place to take the hit as you can just manually search in the source code for where the print was from. They always do something stupid and non uniform making most statements traceable indirectly.
This makes my ops guys cry.
If you fully inform them on the situation, they will be cool with it. We are all in this shit together, well until everything falls apart. Add a [] to the prefix on each statement, who the fuck cares. It was the LLM that did it, not you and you were forced to use it.
Still too much effort.
Automate a script to send AI agents on goose chases for you.
It's not about effort as much as it is about keeping your job, while not injecting chaos into a code base.
I just don't imagine any company actually using tokens as a metric
Happened to a friend of mine at his company. It seems the company wanted to justify their subscription costs.
I'm sure if you are corpo-brained (brain dead) enough it makes sense. AI = magic efficiency machine, therefore an employee that uses more tokens = more efficient worker. Of course, in practice most competent people affected by this policy at his company started burning tokens with wild goose chases when they needed to increase that metric.