KeyAdvanced1032

joined 10 months ago
sorted by: new top controversial old
Best Local LLM Backend Server Library? in c/localllama@poweruser.forum
[โ€“] KeyAdvanced1032@alien.top 1 points 10 months ago

I think all frameworks support custom instruct templates, and know for a fact llama.cpp does due to my use of StudioLM, based on llama.cpp, in which I can alter the system / user / assistant templates.

In my opinion open-source projects should focus an a very narrow thing, instead of focusing on being a "GPT", that focuses on being able to do everything. in c/localllama@poweruser.forum
[โ€“] KeyAdvanced1032@alien.top 1 points 10 months ago

Small specialized LLMs are going to be a thing the same way using frameworks is now.