this post was submitted on 28 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

i know with GTP you can get an api key the buy tokens. I would like to create an SAAS for an AI product/service. The end user would use my UI, which would create a workflow that hits the AI back end, and returns a result. which is then presented to user

great. i can go ahead and code it locallly using GPT4 Api. Or i can code it against a local model.

Now how would i go about hosting that so i can sell this as a SAAS for others?

specifically i am interested in the economics. how would i calculate how much a user should pay so i cover my costs plus some profit. Looking for the formula but i am unclear on its variables. is it gpu time used at run pod for example?

if someoen has done something like this, please explain your thinking os i can do the 'back of napkin calculations'

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here