this post was submitted on 29 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Error while loading deepseek 67b gguf on ooba (alien.top)
submitted 9 months ago by Dry_Long3157@alien.top to c/localllama@poweruser.forum
1 comments fedilink hide all child comments
 

Hey,

I'm trying to load TheBloke/deepseek-llm-67b-chat-GGUF 4_K_M with the llama.cpp loader and I keep running into this error. Please let me know how to fix. TIA.

https://preview.redd.it/4qymemytpb3c1.png?width=889&format=png&auto=webp&s=ee97cbe31b3625ef9b1bcc21ba74407a90651f8d

top 1 comments
sorted by: hot top controversial new old
[–] uti24@alien.top 1 points 9 months ago

Maybe you need to update ooba, but I can confirm, today I loaded and played a bit with deepseek 67b gguf 4_K_M on windows, run on CPU.