ageorgios

joined 10 months ago
sorted by: new top controversial old
Macs with 32GB of memory can run 70B models with the GPU. in c/localllama@poweruser.forum
[–] ageorgios@alien.top 1 points 9 months ago

85% of 32GB RAM would be 27200MB
I have no prior knowledge of the command though