LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

most powerful model for an A6000? (alien.top)

submitted 11 months ago by crackinthekraken@alien.top to c/localllama@poweruser.forum

11 comments fedilink hide all child comments

so I got this shiny new GPU and I want to push it to the limit. What’s the most powerful, smartest model out there? Ideally something with as much long-term memory as possible. I’m coming off of ChatGPT 4 and want something local and uncensored

you are viewing a single comment's thread
view the rest of the comments

[–] lemonlimeandbitters@alien.top 1 points 11 months ago (1 children)

I'm also mucking about with A6000's. 120b models quantised to 3bpw fit well with a 4K context in 48gb and are a lot of fun. Of course, soon you'll realise how much more you can do with 2 a6000s…

[–] crackinthekraken@alien.top 1 points 11 months ago

What's your favorite model that you've been using?