you can probably run TheBloke/Chronoboros-33B-GGUF pretty ok.
trollsalot1234
joined 10 months ago
Alright, super technical review time: I got this running on the potato I connect to Reddit with, even though I usually only try gguf and only on days when the sun is shining and God seems happy. It made my Gtx 1070 ti cry (see I told you I would be technical!), but it worked. Then I altered a demo prompt, and it wrote me a story at about 1 token every 3 seconds where Little Red Riding Hood drank pee. So I'm giving this model a score of 8.6 dead babies, which is better than Tiefighter.
I have no idea how your model is but that prompting guide is probably the nicest one I've seen, so kudos on that.
I mean the closest I've ever come to being a prompt engineer is using Sillytavern to jack off and I've heard of Andrew Ng.
I...also L ove oliath! I ...... i RALLY hope you're is better. A random hallucination walks up and punches trollsalot right in the face. WHY ARENT WE HAVING SEX YET! she screams