this post was submitted on 19 Aug 2026
626 points (98.9% liked)

Technology

87402 readers
5694 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] ranzispa@mander.xyz 1 points 1 day ago (1 children)

What is the need of 192GB?

I often execute calculations on a cluster where I'll need some 500-1000 GB of ram. But I have 32 GB in my workstation and I never felt I needed more.

Everything I need to do I can do: I can be having many browser tabs open, several IDEs, compiling and have a game engine open at the same time.

Only times I fill the ram is when I stress test my software for ram usage, but that is to be expected.

[–] brucethemoose@lemmy.world 1 points 1 day ago (1 children)

Machine learning/data science stuff.

Local LLMs is half of it.

But that aside, I found myself working with huge files that swapped like crazy on my 32GB of RAM, or were completely infeasible to work with. Janky local experiments I wouldn’t want to run on a cloud instance billed by the minute.

128GB has been a godsend, but I could completely fill 192GB and still swap some if I had it.

But I found there are happy side effects to having so much disk cache, too. For instance, game modding/tinkering has sped up immensely over 32GB. So has hashing for transfers, or other scenarios where it’s useful to already have a file cached in RAM.

[–] ranzispa@mander.xyz 2 points 1 day ago (1 children)

Fair, I guess I'd also want some ram if I did not have access to a compute cluster.

But to be fair, for what I do I don't really think you can fit that much ram on a consumer motherboard.

In machine learning I don't generally find memory to be the bottleneck, as long as the GPU can handle it.

But sure, opening huge files can be big trouble.

[–] brucethemoose@lemmy.world 1 points 1 day ago

I can rent cloud stuff, but it's just not worth it for casual/experimental use.

Like keeping Deepseek V4 loaded and hitting it rarely, but I want it to be in my control... it's just easier to do it locally.

Or experiments I launch like 30 times before it works. I'd waste hours moving all my stuff to a cloud instance, configuring it, tinkering with the experiment to get it to launch; the thing would be idle the vast majority of the time. And yeah, I know I can containerize stuff, but some projects I can't even test without a sizable memory pool.