teddybear082

joined 9 months ago
sorted by: new top controversial old
Pay as you go for opensouce models in c/localllama@poweruser.forum
[–] teddybear082@alien.top 1 points 9 months ago

Openrouter and some of the models hosted are free.

Google colab but depends on how long google will let you use it for free (you can also pay monthly)

Llama.cpp on colab with Bakllava-1.Q8_0 (Mistral+LLaVA 1.5) in c/localllama@poweruser.forum
[–] teddybear082@alien.top 1 points 9 months ago

I had done something similar and set up a little chat bot with whisper, stable diffusion, llava and speech to text (me know if you want me to send you a link) but I hadn’t seen before what you did with the google-colab-output eval js cell. Is that basically a way to create a tunnel without having to use trycloudflare or similar? If so that’s awesome!