I'm sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.
luncheroo
joined 1 year ago
Just a quick note for anyone using LM Studio who doesn't want to fiddle too much--the Codellama OpenAssistant preset works fine without ask/answer loops.
I'm going to petition Huggingface to add it.