Dankmre

joined 10 months ago
sorted by: new top controversial old
X.AI Grok could potentially be open sourced on a 6 month delay from launch in c/localllama@poweruser.forum
[–] Dankmre@alien.top 1 points 9 months ago

Meanwhile only like 3 people can even use grok atm

Chassis only has space for 1 GPU - Llama 2 70b possible on a budget? in c/localllama@poweruser.forum
[–] Dankmre@alien.top 1 points 9 months ago

Op seems to want 5-10 T/s on a budget with 70B.... Not going to happen I think.

The Acer Intel A770 16GB GPU is now $250. You won't find a better new 16GB GPU for less. in c/localllama@poweruser.forum
[–] Dankmre@alien.top 1 points 10 months ago

I remain skeptical of intel arc compatibility. It is a good deal but that probably why.

For instance would koboldcpp let me offload to both an intel and nvidia card?

What is the best 13b right now? in c/localllama@poweruser.forum
[–] Dankmre@alien.top 1 points 10 months ago

Things move so fast I don’t mind the threads about it.