LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 1 year ago by TechieRathor@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Right now I really only know about and LM Studio for running and using models, I feel like it's really good and useful but closed source.

Then I saw this (https://www.reddit.com/r/LocalLLaMA/comments/16eoozu/best_software_webgui/) thread here and came to know about so many but didn't found anyone built with .NET and C#. I am thinking of building one but frankly have no clue of how to start with it.

Does anyone knows about any any open source local LLM GUI built with .NET Framework or help/ guide me in getting started with building one.

you are viewing a single comment's thread
view the rest of the comments

[–] m98789@alien.top 1 points 1 year ago

Just do what we all do: .NET wrapping a Docker container service running your LLM with some Python framework exposing a micro service with FastAPI.