this post was submitted on 25 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
China is retrofitting consumer RTX4090s with 2 slot blower for ML (www.tomshardware.com)
submitted 10 months ago by --dany--@alien.top to c/localllama@poweruser.forum
22 comments fedilink hide all child comments
 

This is the reason why you can't find ones in your local best buy. They are paying premium for it. But it indeed is very helpful, if I can get my hand on a few for my build.

you are viewing a single comment's thread
view the rest of the comments
[–] thebliket@alien.top 1 points 10 months ago (1 children)

why are they getting 4090s when 3090s have the same 24gb memory?

[–] fallingdowndizzyvr@alien.top 1 points 9 months ago (2 children)

Because 4090s are faster. Companies don't use these things for inferring like most people do at home. That's low compute and basically memory bandwidth dependent. Companies use these for training. Which is high compute. A 4090 is much faster than a 3090.

And they are busy putting 48GB on those 3090s.

https://www.techpowerup.com/img/erPhoONBSBprjXvM.jpg

[–] NickUnrelatedToPost@alien.top 1 points 9 months ago (1 children)

Although I don't doubt you, the rendering looks as fake as it gets.

But is there a way to fankenstein more RAM on a existing 3090? Are there shops I could send mine to?

[–] fallingdowndizzyvr@alien.top 1 points 9 months ago

Although I don't doubt you, the rendering looks as fake as it gets.

Here's the attribution for that image, "Social media is abuzz with a screengrab of a regional webpage of the NVIDIA website purporting a "GeForce RTX 3090 CEO Edition" graphics card. "

So tell nvidia to up their rendering game. They should know a little something about graphics or at least know someone that does.

But is there a way to fankenstein more RAM on a existing 3090? Are there shops I could send mine to?

Supposedly those exact frankensteins are available in China. A poster here on this sub has reported buying some. If you were in China, you could take your 3090 to any of the endless Chinese tech center booths with dudes with the skills and equipment to try to do it. I would ask if they've done it before though. You don't want to be the one they learn on.

[–] alexgand@alien.top 1 points 9 months ago

What? Was the 48GB 3090 consumer available?