Check Ollama, they have links on their GitHub page to stuff using it, and they have an android app that I believe runs locally on the phone. It uses llama.cpp
Nixellion
joined 11 months ago
Check Ollama, they have links on their GitHub page to stuff using it, and they have an android app that I believe runs locally on the phone. It uses llama.cpp
Privacy and cost Also no, 7B is as fast or faster than ChatGPT depending on ChatGPT load.