Check Ollama, they have links on their GitHub page to stuff using it, and they have an android app that I believe runs locally on the phone. It uses llama.cpp
Nixellion
joined 1 year ago
Check Ollama, they have links on their GitHub page to stuff using it, and they have an android app that I believe runs locally on the phone. It uses llama.cpp
Privacy and cost Also no, 7B is as fast or faster than ChatGPT depending on ChatGPT load.