woadwarrior

joined 1 year ago

are there any Super Tiny LLM models which we can ship within a mobile application? in c/localllama@poweruser.forum

[–] woadwarrior@alien.top 1 points 1 year ago (1 children)

I have an app on the App Store that does that. It ships with a 4 bit quantised 3B parameter LLM baked in (The app is a 1.67GB download) and users on newer phones (iPhone 14,15 Pro and Pro Max) can optionally download a 3 bit quantised 7B parameter LLM.

permalink
fedilink
source

Has anyone else seen this extreme scaremongering ad on YT? in c/localllama@poweruser.forum

[–] woadwarrior@alien.top 1 points 1 year ago

21st century Luddites.

permalink
fedilink
source