LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Do you think there's a market for local LLMs? (alien.top)

submitted 9 months ago by CrimsonPilgrim@alien.top to c/localllama@poweruser.forum

11 comments fedilink hide all child comments

I'm a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI...).

I'm constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there's a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

you are viewing a single comment's thread
view the rest of the comments

[–] Temporary-Size7310@alien.top 1 points 9 months ago

Absolutely (I'm a datascientist too), I own a fresh company in ML/DL/AI and it works pretty well.

There is so much room for creation even with current models (RAG pipeline on private data, prototyping locally and train or finetune on instances, real world application mixing others branch like CV, cinematography with SD, implementing liquid NN with LLM and so on)