this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Pay as you go for opensouce models (alien.top)
submitted 11 months ago by OpeningRecognition69@alien.top to c/localllama@poweruser.forum
7 comments fedilink hide all child comments
 

I dont have budget for hosting models on dedicated GPU, what are the alternative options or platforms that let me use Opensource models like mistral, Llamas, etc in a pay per API call basis ?

you are viewing a single comment's thread
view the rest of the comments
[–] teddybear082@alien.top 1 points 11 months ago

Openrouter and some of the models hosted are free.

Google colab but depends on how long google will let you use it for free (you can also pay monthly)