this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
What are the advantages of running local LLMs? I'm interested in coding-assistant especially. (alien.top)
submitted 10 months ago by Ecstatic_Ring8186@alien.top to c/localllama@poweruser.forum
3 comments fedilink hide all child comments
 

Hello,

With the new GPT4 and its 128k context window, my question is, is there an advantage to running a local LLM?

  • Cost Considerations: Is there a cost benefit to running a local LLM compared to OpenAI?

  • Specialized Training: Is it possible to train the model for specific tasks, similar to 'Code Llama - Python', but perhaps for areas like 'Code Llama - Unreal Engine'?

I understand that for some applications, avoiding the content restrictions of OpenAI might be a plus. However, when it comes to using an LLM as a coding assistant, are there any specific advantages to running it locally?

you are viewing a single comment's thread
view the rest of the comments
[–] Slimxshadyx@alien.top 1 points 10 months ago

Passing it proprietary code is probably on the top of the list.