sammcj

joined 11 months ago
sorted by: new top controversial old
Macs with 32GB of memory can run 70B models with the GPU. in c/localllama@poweruser.forum
[–] sammcj@alien.top 1 points 9 months ago (1 children)

I should probably give that a go on my 96GB M2 Max. I haven’t done much reading on that model,

Tesla P40 cards - what cooling solutions work well? in c/localllama@poweruser.forum
Tesla P40 cards - what cooling solutions work well? in c/localllama@poweruser.forum
[–] sammcj@alien.top 1 points 10 months ago (2 children)

I printed a loopback style fan adapter and chucked a big ol' terdo fan on my P100

https://preview.redd.it/c7sd0vb4gu1c1.jpeg?width=1024&format=pjpg&auto=webp&s=f107e223b56a0f177434ae03b23236faa2674575

I built Copilot replacement in c/localllama@poweruser.forum
[–] sammcj@alien.top 1 points 10 months ago

The readme states "🚀 As good as Copilot" - that's a massive claim which I highly doubt. Does it even have the context of your repo and open tabs?

Biden Executive Order regulates VERY large models in c/localllama@poweruser.forum
[–] sammcj@alien.top 1 points 10 months ago (1 children)

The legislation is going to get old, fast.