No_Afternoon_4260

joined 10 months ago
sorted by: new top controversial old
I found out Laptop 3080 Ti has 16GB VRAM GDDR6 while desktop 3080 Ti has 12GB GDDR6X, what's better? in c/localllama@poweruser.forum
[–] No_Afternoon_4260@alien.top 1 points 9 months ago

You mind shooting a few test to have real word numbers for the laptop version? Like what kind of speeds are you getting for a 7b q6 and 13b q6, they should fully fit in VRAM

I found out Laptop 3080 Ti has 16GB VRAM GDDR6 while desktop 3080 Ti has 12GB GDDR6X, what's better? in c/localllama@poweruser.forum
[–] No_Afternoon_4260@alien.top 1 points 10 months ago

You mind shooting a few test to have real word numbers? Like what kind of speeds are you getting for a 7b q6 and 13b q6, they should fully fit in VRAM

Yi-23B-Llama: Distil version of Yi-34B-Llama in c/localllama@poweruser.forum
[–] No_Afternoon_4260@alien.top 1 points 10 months ago (1 children)

You took a picture of nous capybara..

Any guides for creating an LLM that you can continually feed info to like a “diary”? in c/localllama@poweruser.forum
[–] No_Afternoon_4260@alien.top 1 points 10 months ago

May be some kind of memgpt..

Apple M3 Pro Chip Has 25% Less Memory Bandwidth Than M1/M2 Pro in c/localllama@poweruser.forum