LocalLLaMA

11 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

submitted 2 years ago by Malin_Kite@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

Basically, that's my question. The caveat is that I would like to avoid a Mac Mini and I wonder if some of Minisforum's mini PCs can handle LLM.

you are viewing a single comment's thread
view the rest of the comments

[–] molbal@alien.top 1 points 2 years ago

How about a Zotac zbox? ZBOX QRP7N3500

Max supported memory is 64GB and it has an RTX3050 with 12GB VRAM. I expect that it could run 7b models easily.