robertotomas

joined 9 months ago
sorted by: new top controversial old
Macs with 32GB of memory can run 70B models with the GPU. in c/localllama@poweruser.forum
[–] robertotomas@alien.top 1 points 9 months ago

please followup for actual memory limits, if you hit them