this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Do you think there's a market for local LLMs? (alien.top)
submitted 11 months ago by CrimsonPilgrim@alien.top to c/localllama@poweruser.forum
11 comments fedilink hide all child comments
 

I'm a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI...).

I'm constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there's a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] Glat0s@alien.top 1 points 11 months ago (1 children)

Yes. We are currently planning AI project and implementations in my company. We are handling sensitive data which requires us to do it local. And we want to setup a team and establish compentence and more experience in ML/LLMs. For our current use cases we don't need a "super intelligence" or "the best" LLM on the market ! RAG with smaller models is totally fine and sufficient for us.

[โ€“] artelligence_consult@alien.top 1 points 11 months ago

. We are handling sensitive data which requires us to do it local

Likely this is incompetence on your end because - cough - OpenAI models are available under Azure and ok for even medical data. Takes some reading - but most "confidential, cannot use cloud" is "too stupid to read contracts". Ther are some edge cases, but heck, you can even get government use approved from Azure.