LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Multi GPU vs Single GPU with same VRAM (alien.top)

submitted 11 months ago by -Lousy@alien.top to c/localllama@poweruser.forum

2 comments fedilink hide all child comments

It seems a fair bit cheaper to hit a certain VRAM target with multi vs single GPU setups. I'm wondering if there are any *recent* experiments or blog posts I can read to learn more about what GPU's would be best to get with the black friday sales coming up

you are viewing a single comment's thread
view the rest of the comments

[–] the320x200@alien.top 1 points 11 months ago

One practical consideration is that if you get two cheaper GPUs your upgrade path is a lot worse. If 6 months or a year goes by and you decide you want more memory you have to basically scrap those and start over again if you've used up all your PCI slots whereas if you had one high memory card you would have the possibility of adding a second one to get more memory in the future.