LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Error while loading deepseek 67b gguf on ooba (alien.top)

submitted 11 months ago by Dry_Long3157@alien.top to c/localllama@poweruser.forum

1 comments fedilink hide all child comments

Hey,

I'm trying to load TheBloke/deepseek-llm-67b-chat-GGUF 4_K_M with the llama.cpp loader and I keep running into this error. Please let me know how to fix. TIA.

https://preview.redd.it/4qymemytpb3c1.png?width=889&format=png&auto=webp&s=ee97cbe31b3625ef9b1bcc21ba74407a90651f8d

top 1 comments

sorted by: hot top controversial new old

[–] uti24@alien.top 1 points 11 months ago

Maybe you need to update ooba, but I can confirm, today I loaded and played a bit with deepseek 67b gguf 4_K_M on windows, run on CPU.

permalink
fedilink
source