LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

I found out Laptop 3080 Ti has 16GB VRAM GDDR6 while desktop 3080 Ti has 12GB GDDR6X, what's better? (alien.top)

submitted 10 months ago by hysterian@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

Title sums it up.

you are viewing a single comment's thread
view the rest of the comments

[–] No_Afternoon_4260@alien.top 1 points 10 months ago

You mind shooting a few test to have real word numbers? Like what kind of speeds are you getting for a 7b q6 and 13b q6, they should fully fit in VRAM

permalink
fedilink
source
parent