Appleseed_ss

joined 11 months ago

I’m extremely confused about system requirements. Some people are worried about ram and others about vram. I have 64gb of ram and 12gb vram. What size of model can I run? in c/localllama@poweruser.forum

[–] Appleseed_ss@alien.top 1 points 11 months ago

I have the same specs and basically any of the 7b and 13b models run great using Ollama.