nested_dreams

joined 11 months ago
sorted by: new top controversial old
Deepseek llm 67b Chat & Base in c/localllama@poweruser.forum
[–] nested_dreams@alien.top 1 points 11 months ago

Brother u/The-Bloke , can we get a quant of the uncensored base model too? ♥╣[-_-]╠♥

Ilya paper about Q* in c/localllama@poweruser.forum
[–] nested_dreams@alien.top 1 points 11 months ago (3 children)

This definitely sounds like the paper. 100% worth the read, surprised I hadn't heard much about it until this ordeal

LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning in c/localllama@poweruser.forum
[–] nested_dreams@alien.top 1 points 11 months ago

Alright, these numbers are kinda wild. u/The-Bloke got any spare compute to quant an LQ Nous-Cappy70B or Goliath-120B?