SativaSawdust

joined 1 year ago
sorted by: new top controversial old
Why is a single a100 so slow? in c/localllama@poweruser.forum
[โ€“] SativaSawdust@alien.top 1 points 11 months ago

Have you tried: import torch print(torch.cuda.is_available())

Why is no one releasing 70b models? in c/localllama@poweruser.forum
[โ€“] SativaSawdust@alien.top 1 points 11 months ago

Look at the market share of video cards with more than 100GB of Vram.