this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

It seems a fair bit cheaper to hit a certain VRAM target with multi vs single GPU setups. I'm wondering if there are any *recent* experiments or blog posts I can read to learn more about what GPU's would be best to get with the black friday sales coming up

top 2 comments
sorted by: hot top controversial new old
[โ€“] Paulonemillionand3@alien.top 1 points 11 months ago

power and heat would be more then double the trouble then with a single card.

[โ€“] the320x200@alien.top 1 points 11 months ago

One practical consideration is that if you get two cheaper GPUs your upgrade path is a lot worse. If 6 months or a year goes by and you decide you want more memory you have to basically scrap those and start over again if you've used up all your PCI slots whereas if you had one high memory card you would have the possibility of adding a second one to get more memory in the future.