LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Pay as you go for opensouce models (alien.top)

submitted 11 months ago by OpeningRecognition69@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

I dont have budget for hosting models on dedicated GPU, what are the alternative options or platforms that let me use Opensource models like mistral, Llamas, etc in a pay per API call basis ?

you are viewing a single comment's thread
view the rest of the comments

[–] sbashe@alien.top 1 points 11 months ago

https://www.anyscale.com/endpoints#hosted Good service. I use all it the time. Also has fine-tuning options if u need.

permalink
fedilink
source