this post was submitted on 29 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Set aside benchmarks, if you had to choose one to use instead of ChatGPT for the next 6 months, which one would you pick? Recently, I've been experiencing some extreme slow down and poor answers on GPT so I'm going to run a local backup for the time being to assist when GPT4 is down. I'm leaning towards Mistral. I can be convinced to test some others, though.

you are viewing a single comment's thread
view the rest of the comments
[–] RiotNrrd2001@alien.top 1 points 11 months ago

I keep trying new models, and I keep going back to Dolphin-Mistral-2.2.1. There is something about the quality of the interactions that is different from the other models, and is, I don't know, unexplainably better. I cannot identify why this remains in my mind the best model of all models I've tested, clear up to 33b (the largest my pitiful machine will load), but I continue to think this. Now, I haven't tested every model, so my opinion is completely anecdotal. Dolphin just kicks it, though. It just does such a good job at almost everything I throw at it. I won't say it doesn't foul up here and there, but it still blows the other small models out of the water as far as I'm concerned.