LocalLLaMA

11 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

Mozilla Llamafile - bundling one model & llama.cpp into a single executable (alien.top)

submitted 2 years ago by Danmoreng@alien.top to c/localllama@poweruser.forum

4 comments fedilink hide all child comments

Just read about this project on Twitter and it sounds really interesting:

https://github.com/mozilla-Ocho/llamafile

What do guys think, might be even more simple than Ollama?

you are viewing a single comment's thread
view the rest of the comments

[–] FPham@alien.top 1 points 2 years ago

I find it very strange attaching the gguf file to an exe - it's a very bad security idea (your antivirus needs to hash 10 GB file) and then on windows you still need to split it to exe and data, because the exe limit is 4GB so basically instead of llama.cpp you are now using llamafile that is llamacpp. Or am I missing something?