LocalLLaMA

4 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

Any Open Source Local LLM GUI Built with .NET Framework. (alien.top)

submitted 2 years ago by TechieRathor@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Right now I really only know about and LM Studio for running and using models, I feel like it's really good and useful but closed source.

Then I saw this (https://www.reddit.com/r/LocalLLaMA/comments/16eoozu/best_software_webgui/) thread here and came to know about so many but didn't found anyone built with .NET and C#. I am thinking of building one but frankly have no clue of how to start with it.

Does anyone knows about any any open source local LLM GUI built with .NET Framework or help/ guide me in getting started with building one.

you are viewing a single comment's thread
view the rest of the comments

[–] mrjackspade@alien.top 1 points 2 years ago

If you're trying to do something novel as part of a learning experiment, just pick a good UI framework and then either wrap LlamaSharp, or interop directly with Llama.cpp using PInvoke.

Personally I just use PInvoke to cut out the middle man

As for a UI framework, I've been having a lot of fun with Avalonia lately.

You're not going to get 100% interop with all models using Llama.cpp as a core but if this is a learning exercise then I'm sure that's not an issue.

That being said, if you really want to you can fuck around with Python.net but you may find yourself spending way more time trying to manage model interop and execution than you want to.