this post was submitted on 27 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
most powerful model for an A6000? (alien.top)
submitted 11 months ago by crackinthekraken@alien.top to c/localllama@poweruser.forum
11 comments fedilink hide all child comments
 

so I got this shiny new GPU and I want to push it to the limit. What’s the most powerful, smartest model out there? Ideally something with as much long-term memory as possible. I’m coming off of ChatGPT 4 and want something local and uncensored

you are viewing a single comment's thread
view the rest of the comments
[–] crackinthekraken@alien.top 1 points 11 months ago (1 children)

I also have a 3080ti! I didn't even know it was possible to combine them. Where can I go to learn how?

[–] chrisssssssssn@alien.top 1 points 11 months ago

Hugging face will have some models you can download. Look at GitHub for llama and other repositories that will get you going. I just started playing around with local LLMs and it’s been an interesting journey mainly because I am using MacBook Pro - just the M2Pro with 16gig shared memory. So far I have been playing with 13b models with decent results. You may want to check out on GitHub localaivoicechat for something that will allow you to talk with your voice and have realtime voice playback of the generated ai response. There are many others there like oobabooga, sillytavern, text-generation-webui and many others. Start looking into those for now and it will open that can o worms for you. LM Studio is also something to check out. Good luck. It’s much easier and more compatible using PC based ai generating tools than on a Mac but so far I’m doing ok. You will have it much better and more compatible. Hope that helps a bit.