LOLatent

joined 10 months ago
sorted by: new top controversial old
How much does Quantization actually impact models? - KL Divergence Tests in c/localllama@poweruser.forum
[–] LOLatent@alien.top 1 points 10 months ago

I’m in the exact same boat, if you get an answer, pls lettus know! 7b q8 or 13b q4?

Local LLM sends my conversions to developers despite privacy claim. in c/localllama@poweruser.forum
[–] LOLatent@alien.top 1 points 10 months ago

I thought I’ll see some damning wireshark traces, but all I got was someone who doesn’t know how to use an llm…