LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

China is retrofitting consumer RTX4090s with 2 slot blower for ML (www.tomshardware.com)

submitted 10 months ago by --dany--@alien.top to c/localllama@poweruser.forum

22 comments fedilink hide all child comments

This is the reason why you can't find ones in your local best buy. They are paying premium for it. But it indeed is very helpful, if I can get my hand on a few for my build.

you are viewing a single comment's thread
view the rest of the comments

[–] trailer_dog@alien.top 1 points 10 months ago (5 children)

China needs to start pumping out their own dedicated AI accelerator cards. I'm sick of Nvidia's VRAM business model. Having to run multiple giant GPUs in parallel instead of simply soldering more RAM chips onto the board is extremely wasteful.

[–] fallingdowndizzyvr@alien.top 1 points 10 months ago (2 children)

China needs to start pumping out their own dedicated AI accelerator cards.

They already do. Or should I say would.

https://www.tomshardware.com/news/chinese-biren-rolls-out-new-gpus-with-77-billion-transistors-2-pflops-of-ai-performance

The problem for China is that like the US, they have to have Taiwan build their chips for them. And the US has told Taiwan in no uncertain terms that they better not build chips for China or else. So even though they have their own designs, they can't get them built. Or should I say they couldn't. Since China pulled a July surprise when Huawei released domestically made 7nm chips. 7nm is what the BR100 is designed to be made at. It was thought that China wouldn't be able to make 7nm chips for at least another 5 years.

Having to run multiple giant GPUs in parallel instead of simply soldering more RAM chips onto the board is extremely wasteful.

That's not what they do. They use custom PCBs. Even the 16GB RX580 is not a piggy backed 8GB RX580. They basically harvest the chips from an existing card and then solder them onto a newly designed PCB.

[–] MrArborsexual@alien.top 1 points 10 months ago (1 children)

I mean Taiwan isn't exactly jumping at the chance to build advance chips for the rougue provences of West Taiwan, that constantly warn of their impeding violent invasion of Taiwan.

Also their yields at 7nm are apparently terrible, assuming they are being honest about the actual production. A few years ago China put out news of a home grown x86 chip that was on par with Zen 1 or something like that, and it turned out they had just repackaged old chips.

[–] fallingdowndizzyvr@alien.top 1 points 10 months ago

I mean Taiwan isn't exactly jumping at the chance to build advance chips for the rogue provences of West Taiwan, that constantly warn of their impeding violent invasion of Taiwan.

Ah... then why are they trying to convince the US to give them a license to run factories in China. TSMC, you know those Taiwan chipmakers, want the US to give them permanent license to run factories those "rogue provences of West Taiwan".

You know what a good way is to keep someone from invading you? Be so crucial that they don't want to even risk damaging you in any way. They would be making chips for them right now if the US allowed it.

load more comments (2 replies)