LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

Should corporations and smaller businesses be training, refining, and running local LLMs to avoid the future cost of the new cloud services M$ and Amazon are rolling out? (alien.top)

submitted 11 months ago by 3-4pm@alien.top to c/localllama@poweruser.forum

16 comments fedilink hide all child comments

It seems to me that the next big boom for cloud computing will be offering to train and host models that understand the unique business domains it serves.

Are the smart corporations already training local LLMs to understand and answer questions about their business, or is this space too new to accommodate them?

I feel like some of you may be missing a huge business opportunity. You may not realize the value of what you have already researched.

you are viewing a single comment's thread
view the rest of the comments

[–] FlishFlashman@alien.top 1 points 11 months ago (1 children)

That's probably the argument for all cloud architecture.

Long-term cost and risk might be persuasive, that hasn't swayed IT managers thus far for non-LLM specific infrastructure

It's 2023. What are you talking about? Where have you been?

[–] _-inside-_@alien.top 1 points 11 months ago

Not everyone still uses the cloud, I still know people who run and manage physical clusters. This is mostly true for institutions such as hospitals, universities, etc. Using cloud solutions on these cases not just would add external dependencies but also much higher costs, for instance, handling and processing hundreds or thousands of terabytes of critical or scientific data.