this post was submitted on 27 May 2026
572 points (98.8% liked)

Technology

84949 readers
4287 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] NotMyOldRedditName@lemmy.world 4 points 5 hours ago* (last edited 5 hours ago) (1 children)

It's one study, so I'd take it with a grain of salt, and also the study says

However, we see positive speedup for the one developer who has more than 50 hours of Cursor experience, so it's plausible that there is a high skill ceiling for using Cursor, such that developers with significant experience see positive speedup.

And a comment I read on it says "56% of the participants had never used Cursor before, 1/4th of the participants did better, 3/4 did worse. One of the top performers for AI was also someone with the most previous Cursor use. "

So it really might just be a tooling / experience issue, and the tooling has also improved substantially over the past year, like Claude Code and Chat GPT's Codex. Outputs from LLMs are substantially better in programming than a year ago.

Edit: Looks like they did a followup study with some of the same participants which is always nice to see. I hope they do a 2027 one and they have the same participants again.

https://metr.org/blog/2026-02-24-uplift-update/#wider-adoption-of-ai-has-made-it-more-difficult-to-measure-task-level-productivity

Our raw results show some evidence for speedup. Our early 2025 study found the use of AI causes tasks to take 19% longer, with a confidence interval between +2% and +39%. For the subset of the original developers who participated in the later study, we now estimate a speedup of -18% with a confidence interval between -38% and +9%. Among newly-recruited developers the estimated speedup is -4%, with a confidence interval between -15% and +9%.

So it's likely people getting used to it, tooling is better, and now they're potentially seeing modest improvements.

[–] TRBoom@lemmy.zip 5 points 5 hours ago (1 children)

They tested it again back in March and got similar results which, being an AI hype company, they buried in their paper.

Many of the programmers refused to not use AI, probably related to the declined cognitive function that some other studies have shown to occur in AI users. I read one testimonial saying that his head would explode if he couldn’t use AI.

So plenty of experience by that point.

[–] NotMyOldRedditName@lemmy.world 2 points 5 hours ago (1 children)

I was editing my reply as you replied, but the new study showed they fared better, not worse or the same. Even the new people to the study fared better, but worse than the existing.

[–] TRBoom@lemmy.zip 1 points 5 hours ago

They said it did better, every news story for their March test says the opposite.

They are an AI hype company. It’s in their interest to tweak the results and the study to make things look better.