MiniEval_

joined 11 months ago
sorted by: new top controversial old
Quantizing 70b models to 4-bit, how much does performance degrade? in c/localllama@poweruser.forum
[–] MiniEval_@alien.top 1 points 11 months ago (2 children)

Dual 3090/4090s. Still pricey as hell, but not out of reach for some folks.