overview for nixudos

Is Open LLM Leaderboard reliable source ? yi:34B is at the top but I get better results with neural-chat:7B model in c/localllama@poweruser.forum

[–] nixudos@alien.top 1 points 9 months ago

Does anyone have a setup that works with a Yi34b model on 12GB vram and 32GB ram? I have tried using GGUF but I always end up with the answer. I'm on Oobabooga and any specific settings to overcome this hurdle with GGUF would be greatly appreciated! I

Your settings are (probably) hurting your model - Why sampler settings matter in c/localllama@poweruser.forum

[–] nixudos@alien.top 1 points 10 months ago

I'm having a lot of fun with it on the following settings for story writing.
I feel like there is loads of grat potential in min_P, once I get it dialed in!

https://preview.redd.it/9in73daoix1c1.png?width=619&format=png&auto=webp&s=3f51101d0a40c02ef46de163a707164d28a68f7f

The smartest model under the sun: Prof. McSmarty BS 13b GPTQ in c/localllama@poweruser.forum

[–] nixudos@alien.top 1 points 10 months ago

You should give Elon Musk access to this one and charge him by the word 👍😁