LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 11 months ago by A0sanitycomp@alien.top to c/localllama@poweruser.forum

14 comments fedilink hide all child comments

From what I’ve read mac somehow uses system ram and windows uses the gpu? It doesn’t make any sense to me. Any help appreciated.

you are viewing a single comment's thread
view the rest of the comments

[–] ID4gotten@alien.top 1 points 11 months ago

Do you mean
(RAM gb + VRAM gb - 5gb) * billion parameters?
And what is the 5 for? Thanks