LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 11 months ago by Malin_Kite@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

Basically, that's my question. The caveat is that I would like to avoid a Mac Mini and I wonder if some of Minisforum's mini PCs can handle LLM.

you are viewing a single comment's thread
view the rest of the comments

[–] unculturedperl@alien.top 1 points 11 months ago

How mini do you want? I plugged a llama2 7b into an N100 w/16gb and ran it, speed was not very good.

Real question is what are you trying to accomplish and is this the best route to do so?