this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

11 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
Do you think there's a market for local LLMs? (alien.top)
submitted 2 years ago by CrimsonPilgrim@alien.top to c/localllama@poweruser.forum
11 comments fedilink hide all child comments
 

I'm a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI...).

I'm constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there's a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

you are viewing a single comment's thread
view the rest of the comments
[–] noco-ai@alien.top 1 points 2 years ago

OpenAI is also so overwhelmed with demand that their API "limits" are a complete joke. I have a tier 4 account and have always hit server error issues when running any kind of single threaded application with their API well before hitting any of their published limits. I get more TPS from my local systems than I was ever able to get from the OpenAI API.