kruk2

joined 10 months ago

Where and how to run Goliath 120b GGUF with good performance? in c/localllama@poweruser.forum

[–] kruk2@alien.top 1 points 10 months ago (2 children)

or open the UI, go to model page, right click on the layers slider -> inspect element
and update max value for the input field from 128 to 256

The Problem with LLMs for chat or roleplay in c/localllama@poweruser.forum

[–] kruk2@alien.top 1 points 10 months ago

Which 70b do you recommend? Any loras?
What is SillyTaver swiping?