LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

local llm in own GUI (alien.top)

submitted 11 months ago by CultOfAmagi@alien.top to c/localllama@poweruser.forum

8 comments fedilink hide all child comments

Hi community,

i am writing my own GUI in wich i want to use a LLM completely local. The problem is i dont know how to start with the LLM.

Can someone explain to me how the first steps work to integrate/work with the LLM or does someone know some good tutorials?

The LLM is downloaded localy. Now i need to integrate a library or something? sry i could not find a lot useful/direct information about the topic.

Thank you very much in advance!

you are viewing a single comment's thread
view the rest of the comments

[–] e-nigmaNL@alien.top 1 points 11 months ago

I did the same thing. Read dozens of articles, watched even more YouTube vids and leeching info on this sub I’ve created a simple chat UI using llama and I’ve also created a simple RAG setup. Ofcourse you can run out of the box ui’s, like oobabooga’s text-gen-webui or even the huggingface, but I wanted to learn python and AI at the same time :) DM me if you want to discuss stuff