tech92yc

joined 1 year ago
sorted by: new top controversial old
64GB RAM vs 3060 12GB vs Intel a770? in c/localllama@poweruser.forum
[โ€“] tech92yc@alien.top 1 points 1 year ago

get a used Nvidia GPU , the Cuda acceleration changes everything (x20-x50 performance)

Don't waste your time on CPU inference, also Intel A770 doesn't have the software support

The closest I got to ChatGPT+Dall-E locally (SDXL+LLaMA2-13B-Tiefighter) in c/localllama@poweruser.forum
[โ€“] tech92yc@alien.top 1 points 1 year ago

Of course this has been available locally for months and its performance is amazing, better than the OpenAI alternative