LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Pay as you go for opensouce models (alien.top)

submitted 11 months ago by OpeningRecognition69@alien.top to c/localllama@poweruser.forum

7 comments fedilink hide all child comments

I dont have budget for hosting models on dedicated GPU, what are the alternative options or platforms that let me use Opensource models like mistral, Llamas, etc in a pay per API call basis ?

you are viewing a single comment's thread
view the rest of the comments

[–] DarthNebo@alien.top 1 points 11 months ago

HuggingFace has inference endpoint which is private & public as needed with sleep built in

permalink
fedilink
source