LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

llama.cpp for normies: FreeChat is now live on the mac app store (alien.top)

submitted 1 year ago by sleeper-2@alien.top to c/localllama@poweruser.forum

10 comments fedilink hide all child comments

Hey ya'll, quick update about my open source llama.cpp app, FreeChat. As of this weekend it's live on the mac app store. Big thanks to this community for all the feedback and testing, would not have gotten here without ya'll. Next I'm working on the most common request I get here: a model catalog.

Have friends who aren't hackers who you think should try local AI? Send them a link! Hoping to expand local AI usage by making it dead simple.

App Store! https://apps.apple.com/us/app/freechat/id6458534902

And fOR tHe HaCkers: https://github.com/psugihara/FreeChat

you are viewing a single comment's thread
view the rest of the comments

[–] Shir_man@alien.top 1 points 1 year ago

Unfortunately, it does not work with "CasualLM 14B"

Error Loading (causallm_14b.Q5_1.gguf)

Also, as I can see, prompt formatting is not possible to set, is it being selected automatically? ChatML etc