LocalLLaMA

14 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

China is retrofitting consumer RTX4090s with 2 slot blower for ML (www.tomshardware.com)

submitted 2 years ago by --dany--@alien.top to c/localllama@poweruser.forum

22 comments fedilink hide all child comments

This is the reason why you can't find ones in your local best buy. They are paying premium for it. But it indeed is very helpful, if I can get my hand on a few for my build.

you are viewing a single comment's thread
view the rest of the comments

[–] nexusjuan@alien.top 1 points 2 years ago (1 children)

I'm running a Tesla M40 12gb and I'm real close to pulling the trigger on a 24gb. I also have one of the Tesla P4's in my server. With the the M40 I can fully off load 13b models to vram.

[–] thebliket@alien.top 1 points 2 years ago

how does a M40 compare with a A4000?