this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Do you think there's a market for local LLMs? (alien.top)
submitted 11 months ago by CrimsonPilgrim@alien.top to c/localllama@poweruser.forum
11 comments fedilink hide all child comments
 

I'm a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI...).

I'm constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there's a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

you are viewing a single comment's thread
view the rest of the comments
[–] artelligence_consult@alien.top 1 points 11 months ago

. We are handling sensitive data which requires us to do it local

Likely this is incompetence on your end because - cough - OpenAI models are available under Azure and ok for even medical data. Takes some reading - but most "confidential, cannot use cloud" is "too stupid to read contracts". Ther are some edge cases, but heck, you can even get government use approved from Azure.