LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

Should corporations and smaller businesses be training, refining, and running local LLMs to avoid the future cost of the new cloud services M$ and Amazon are rolling out? (alien.top)

submitted 9 months ago by 3-4pm@alien.top to c/localllama@poweruser.forum

16 comments fedilink hide all child comments

It seems to me that the next big boom for cloud computing will be offering to train and host models that understand the unique business domains it serves.

Are the smart corporations already training local LLMs to understand and answer questions about their business, or is this space too new to accommodate them?

I feel like some of you may be missing a huge business opportunity. You may not realize the value of what you have already researched.

you are viewing a single comment's thread
view the rest of the comments

[–] zer00eyz@alien.top 1 points 9 months ago

Someone has not gone and sat down with the legal department.

Who owns LLM generated work? IANAL but based on recent cases it looks like "not you" and "no one" because there is no human hand in the output. It seems that this puts it directly in the public domain.
What does the TOS say at OpenAI and MS right now regarding these items. It doesn't seem very clear and it looks like they are gonna use the OUTPUT for whatever they want. https://foundation.mozilla.org/en/campaigns/microsoft-ai/ Mozilla's making it personal, it might just be a clear statement on "unowned" things that might be "owned" in the future.

Depending on your business, a LLM that does not tell stories, do porn, math, answer logic problems might be wasteful if you want to supercharge customer service by shoving in your own documentation. A thinner model might be cheaper to run at the scale of Fortune 500 CS than say anything azure is offering.

Without doing the math, and you need to have local hardware enough to do the math it's nearly impossible to make any sort of cost benefit analysis.

Cloud for scale is NOT value, cloud for scale is COST... Value is an asset and deprecation on said asset. If you aren't tracking your revenue vs expenses in cloud on a week over week basis, if you dont know your cloud costs per user, or customer (and those are going to be different depending on what you do and how you do it) there is zero corollary between cloud and value. The free money is gone, the belt is only gonna get tighter money needs to be in every metric...