LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Why isn't anyone building an Oogabooga-like app for Android and iPhone? (alien.top)

submitted 11 months ago by Winter_Tension5432@alien.top to c/localllama@poweruser.forum

14 comments fedilink hide all child comments

With high-end Android phones now packing upwards of 24GB of RAM, I think there's huge potential for an app like this. It would be amazing to have something as powerful as the future Mistral 13B model running natively on smartphones!

You could interact with it privately without an internet connection. The convenience and capabilities would be incredible.

you are viewing a single comment's thread
view the rest of the comments

[–] GermanK20@alien.top 1 points 11 months ago (1 children)

People are always building, but the smaller models are kinda pointless

[–] Winter_Tension5432@alien.top 1 points 11 months ago (1 children)

Smaller models are the future of smartphones, everyone's will be running 10b models on their phones by 2025 this are more than enough for creating emails and translations and just asking questions, a lot more useful than siri and alexa.

[–] GermanK20@alien.top 1 points 11 months ago (1 children)

Well, I've just tested a few models for my workflows and found out only 70B cuts it.

[–] Winter_Tension5432@alien.top 1 points 11 months ago

For now, but you will have 13b models as good as 70b models by the end of next year.