this post was submitted on 05 Mar 2025
62 points (80.4% liked)

Technology

64938 readers
5212 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
62
Apple reveals M3 Ultra, taking Apple silicon to a new extreme (www.apple.com)
submitted 4 days ago by simple@lemm.ee to c/technology@lemmy.world
32 comments fedilink hide all child comments
 

512gb of unified memory is insane. The price will be outrageous but for AI enthusiasts it will probably be worth it.

you are viewing a single comment's thread
view the rest of the comments
[–] REDACTED@infosec.pub 3 points 3 days ago (2 children)

Isn't unified memory terrible for AI tho? I kind of doubt it even has bandwidth of a 5 years old vram.

[–] KingRandomGuy@lemmy.world 2 points 2 days ago

This type of thing is mostly used for inference with extremely large models, where a single GPU will have far too little VRAM to even load a model into memory. I doubt people are expecting this to perform particularly fast, they just want to get a model to run at all.

[–] KoalaUnknown@lemmy.world 4 points 3 days ago

While DDR7 DRAM is obviously better, the massive amount of memory can be a massive advantage for some models.