LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Why isn't anyone building an Oogabooga-like app for Android and iPhone? (alien.top)

submitted 10 months ago by Winter_Tension5432@alien.top to c/localllama@poweruser.forum

14 comments fedilink hide all child comments

With high-end Android phones now packing upwards of 24GB of RAM, I think there's huge potential for an app like this. It would be amazing to have something as powerful as the future Mistral 13B model running natively on smartphones!

You could interact with it privately without an internet connection. The convenience and capabilities would be incredible.

you are viewing a single comment's thread
view the rest of the comments

[–] BlackSheepWI@alien.top 1 points 10 months ago (1 children)

It's a lot of work. Phones use a different OS and a different processor instruction set. The latter can be a big pain, especially if you're really dependant on low-level optimizations.

I also feel that -most- people who would choose a phone over PC for this kind of thing would rather just use a high quality easily-accessible commercial option (chatGPT, etc) instead of a homebrew option that required some work to get running. So demand for such a thing is pretty low.

[–] Winter_Tension5432@alien.top 1 points 10 months ago

I'm not so sure, chatgpt has privacy issues and a small model but completely uncensored it has value too. There is a market for this. Convenient and privacy.