this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Simple question, is it worth stopping using Chatgpt (not plus) in order to use a local version of a LLAMA with my current GC ?

top 3 comments
sorted by: hot top controversial new old
[–] Kevinswelt@alien.top 1 points 11 months ago

That depends on your usecase. If only need ChatGPT to do school/office work, then even ChatGPT 3 is way better than even llama 70B. If you run into limitations and get warnings all the time, then any uncensored model will greatly improve your experience. You can easily run GPTQ and GGUF Q8 versions of 7B models like Mistral. 13B models are also possible as GPTQ or GGUF Q3_K_M.

[–] Paulonemillionand3@alien.top 1 points 11 months ago
[–] hibbity@alien.top 1 points 11 months ago