opi098514

joined 1 year ago
sorted by: new top controversial old
How much does Quantization actually impact models? - KL Divergence Tests in c/localllama@poweruser.forum
[–] opi098514@alien.top 1 points 11 months ago

Ok. So im basically an idiot. What does this mean and which one should i use?

TinyLlama Base Model Trained on 2T Tokens Complete in c/localllama@poweruser.forum
[–] opi098514@alien.top 1 points 11 months ago

The bloke has entered the chat.

PSA: If you have Telsa P40 which has abysmal FP16 performance DO NOT update oobabooga past commit 564d0cde8289a9c9602b4d6a2e970659492ad135 in c/localllama@poweruser.forum
[–] opi098514@alien.top 1 points 11 months ago

How many tokens/s do you get with the p40. I’ve been contemplating getting one and using it along side my 3060 12 gig.

Any guides for creating an LLM that you can continually feed info to like a “diary”? in c/localllama@poweruser.forum
[–] opi098514@alien.top 1 points 1 year ago

Is….. that a thing? I need that in my life.

PSA about Mining Rigs in c/localllama@poweruser.forum
[–] opi098514@alien.top 1 points 1 year ago

I didn’t know I needed this information till now

view more: ‹ prev next ›