this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
The newly released Psyfighter2 13B, A better version of Tiefighter? (alien.top)
submitted 2 years ago by Majestical-psyche@alien.top to c/localllama@poweruser.forum
6 comments fedilink hide all child comments
 

https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2-GGUF

you are viewing a single comment's thread
view the rest of the comments
[–] Desm0nt@alien.top 1 points 2 years ago (1 children)

Is it still only 4k context size?

I hope one day someone somehow find a way to extend context of Tiefighter atleast to 8k.
Because it's the perfect model for real-time RP and stories even on weak PCs. It's smarter than all 7b and 13b models and smarter than many 30b models, but the modest context of 4k tokens is eaten up faster than you can enjoy its potential...

[–] Majestical-psyche@alien.top 1 points 2 years ago

Sorry I was playing around with it for the last day… So far I prefer it over 34B Dolphin Yi (GGUF Q4_K_m)… As for context size I only used 8k and it was pretty good with going far back. It might be able to do 12K, idk.. Haven’t tried it.