this post was submitted on 25 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Because 4090s are faster. Companies don't use these things for inferring like most people do at home. That's low compute and basically memory bandwidth dependent. Companies use these for training. Which is high compute. A 4090 is much faster than a 3090.
And they are busy putting 48GB on those 3090s.
https://www.techpowerup.com/img/erPhoONBSBprjXvM.jpg
Although I don't doubt you, the rendering looks as fake as it gets.
But is there a way to fankenstein more RAM on a existing 3090? Are there shops I could send mine to?
Here's the attribution for that image, "Social media is abuzz with a screengrab of a regional webpage of the NVIDIA website purporting a "GeForce RTX 3090 CEO Edition" graphics card. "
So tell nvidia to up their rendering game. They should know a little something about graphics or at least know someone that does.
Supposedly those exact frankensteins are available in China. A poster here on this sub has reported buying some. If you were in China, you could take your 3090 to any of the endless Chinese tech center booths with dudes with the skills and equipment to try to do it. I would ask if they've done it before though. You don't want to be the one they learn on.
What? Was the 48GB 3090 consumer available?