this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
ShareGPT4V - New multi-modal model, improves on LLaVA (sharegpt4v.github.io)
submitted 11 months ago by Cradawx@alien.top to c/localllama@poweruser.forum
17 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] durden111111@alien.top 1 points 11 months ago (1 children)

Hopefully we get GGUFs soon

[–] Cradawx@alien.top 1 points 11 months ago (1 children)

I converted and quantized this to work in llama.cpp

https://huggingface.co/nakodanei/ShareGPT4V-7B_GGUF

[–] durden111111@alien.top 1 points 11 months ago

nice. From my tests it seems to be about the same as LLava v1.5 13B and Bakllava. I'm starting to suspect that the CLIP-Large model all of these multi-model LLMs are using is holding them back.