this post was submitted on 26 Jul 2026
192 points (99.0% liked)

Technology

86628 readers
3336 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Dionysus@leminal.space 12 points 15 hours ago (1 children)

Same, getting ~3 trillion parameters in consumer hardware is rough.

If Nvidia has any foresight they'll see the writing on the wall and start getting higher memory Spark style SMB inference machines, few people in the long run are going to pay retail API token costs,

[–] Greg@lemmy.ca 3 points 12 hours ago (1 children)

Especially giving the lack of trust organizations rightfully have in big AI companies

[–] Dionysus@leminal.space 3 points 11 hours ago

Exactly, having the mustard toddler pull fable because of, who knows? That burned trust in the west's AI companies.

And there is also the question of what they're doing with the data you send into the models.