this post was submitted on 27 Apr 2026
153 points (96.4% liked)

Programming

26701 readers
538 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] boonhet@sopuli.xyz 4 points 7 hours ago

22B

There are 700B+ parameter open weight models now. Frontier models are in the trillions.

And even that model apparently took a supercomputer to train. I don't have a supercomputer so I can't train my own models like I can compile my own software. This is not comparable to running Linux where you can just compile your own kernel or even whole operating system (former Gentoo user here).

I've tried running the models my 8 GB card can handle. They're OK for a quick question, but they won't be doing anything useful for me.