this post was submitted on 19 Aug 2026
625 points (98.9% liked)

Technology

87402 readers
5542 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 1 points 1 day ago (1 children)

Machine learning/data science stuff.

Local LLMs is half of it.

But that aside, I found myself working with huge files that swapped like crazy on my 32GB of RAM, or were completely infeasible to work with. Janky local experiments I wouldn’t want to run on a cloud instance billed by the minute.

128GB has been a godsend, but I could completely fill 192GB and still swap some if I had it.

But I found there are happy side effects to having so much disk cache, too. For instance, game modding/tinkering has sped up immensely over 32GB. So has hashing for transfers, or other scenarios where it’s useful to already have a file cached in RAM.

[–] ranzispa@mander.xyz 2 points 1 day ago (1 children)

Fair, I guess I'd also want some ram if I did not have access to a compute cluster.

But to be fair, for what I do I don't really think you can fit that much ram on a consumer motherboard.

In machine learning I don't generally find memory to be the bottleneck, as long as the GPU can handle it.

But sure, opening huge files can be big trouble.

[–] brucethemoose@lemmy.world 1 points 23 hours ago

I can rent cloud stuff, but it's just not worth it for casual/experimental use.

Like keeping Deepseek V4 loaded and hitting it rarely, but I want it to be in my control... it's just easier to do it locally.

Or experiments I launch like 30 times before it works. I'd waste hours moving all my stuff to a cloud instance, configuring it, tinkering with the experiment to get it to launch; the thing would be idle the vast majority of the time. And yeah, I know I can containerize stuff, but some projects I can't even test without a sizable memory pool.