this post was submitted on 22 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Any interest in C#/.NET for serving LLMs? (alien.top)
submitted 11 months ago by Key-Comparison3261@alien.top to c/localllama@poweruser.forum
3 comments fedilink hide all child comments
 

K024/llm-sharp: Language models in C# (github.com)

I've recently drafted this. But adding more models & features & tests & documentation will just cost too much time. Seeking for comments & colaborators.

you are viewing a single comment's thread
view the rest of the comments
[–] Languages_Learner@alien.top 1 points 11 months ago

This may be useful: saddam213/LLamaSharp: C#/.NET binding of llama.cpp, including LLaMa/GPT model inference and quantization, ASP.NET core integration and UI. (github.com)