trailer_dog

joined 10 months ago
sorted by: new top controversial old
China is retrofitting consumer RTX4090s with 2 slot blower for ML in c/localllama@poweruser.forum
[โ€“] trailer_dog@alien.top 1 points 10 months ago (5 children)

China needs to start pumping out their own dedicated AI accelerator cards. I'm sick of Nvidia's VRAM business model. Having to run multiple giant GPUs in parallel instead of simply soldering more RAM chips onto the board is extremely wasteful.

"Base" models were actually trained with some GPT instruct datasets in c/localllama@poweruser.forum
[โ€“] trailer_dog@alien.top 1 points 10 months ago

So it turns out you just need to train on GPT output for better benchmarks lol. Not to say there's a chance GPT models are contaminated with benchmark test data too. "Distillation" went a little too far. Easy VC money though, I would do the same.