this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Pay as you go for opensouce models (alien.top)
submitted 9 months ago by OpeningRecognition69@alien.top to c/localllama@poweruser.forum
7 comments fedilink hide all child comments
 

I dont have budget for hosting models on dedicated GPU, what are the alternative options or platforms that let me use Opensource models like mistral, Llamas, etc in a pay per API call basis ?

you are viewing a single comment's thread
view the rest of the comments
[–] TradingDreams@alien.top 1 points 9 months ago

It may be out of your range, but you can pick up the dell precision 7720 with a 16gb P5000 GPU for about $500 on eBay. The Quadro P5000 is also in a few other workstation laptop models around that era. Note: They had other graphics options so only go for P5000 models.