this post was submitted on 15 Oct 2026
528 points (98.0% liked)

Technology

89000 readers
3727 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] it_depends_man@lemmy.world 4 points 1 week ago (2 children)

If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use.

Hm, I don't see the harm in powering local models with solar.

[–] Klear@piefed.world 5 points 1 week ago (1 children)

Depends. Is it solar energy that started production to power these models? Great! If not, then you're still consuming power and the difference will have to be made somewhere, likely by burning more fossil fuels.

[–] it_depends_man@lemmy.world 5 points 1 week ago (1 children)

Oh yeah, I mean my own personal solar modules in my backyard. I agree it's not that easy to say "solar exists, checkmate doubters", that would be silly.

[–] Klear@piefed.world 2 points 1 week ago

OK, that is fine. I've seen a lot of people saying stuff like "Me mining crypto doesn't matter because I live next to a wind farm" so I'm a bit wary.

[–] floofloof@lemmy.ca 2 points 1 week ago

Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.